-- Logs begin at Wed 2022-06-15 23:40:08 UTC, end at Thu 2022-06-16 00:57:25 UTC. -- Jun 16 00:18:52.437322 dv-cinder-803823-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 00:18:52.446008 dv-cinder-803823-11-smb devstack@keystone.service[97098]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:18:52 2022] *** Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: nodename: dv-cinder-803823-11-smb Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: machine: x86_64 Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: clock source: unix Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: pcre jit disabled Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: detected number of CPU cores: 4 Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: current working directory: / Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: your processes number limit is 47680 Jun 16 00:18:52.447948 dv-cinder-803823-11-smb devstack@keystone.service[97098]: your memory page size is 4096 bytes Jun 16 00:18:52.448713 dv-cinder-803823-11-smb devstack@keystone.service[97098]: detected max file descriptor number: 2048 Jun 16 00:18:52.448713 dv-cinder-803823-11-smb devstack@keystone.service[97098]: lock engine: pthread robust mutexes Jun 16 00:18:52.448713 dv-cinder-803823-11-smb devstack@keystone.service[97098]: thunder lock: enabled Jun 16 00:18:52.448713 dv-cinder-803823-11-smb devstack@keystone.service[97098]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 00:18:52.448713 dv-cinder-803823-11-smb devstack@keystone.service[97098]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:18:52.492372 dv-cinder-803823-11-smb devstack@keystone.service[97098]: Python main interpreter initialized at 0x5652d8b159c0 Jun 16 00:18:52.492372 dv-cinder-803823-11-smb devstack@keystone.service[97098]: python threads support enabled Jun 16 00:18:52.492372 dv-cinder-803823-11-smb devstack@keystone.service[97098]: your server socket listen backlog is limited to 100 connections Jun 16 00:18:52.492372 dv-cinder-803823-11-smb devstack@keystone.service[97098]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:18:52.492688 dv-cinder-803823-11-smb devstack@keystone.service[97098]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:18:52.492783 dv-cinder-803823-11-smb devstack@keystone.service[97098]: *** Operational MODE: preforking *** Jun 16 00:18:52.493050 dv-cinder-803823-11-smb devstack@keystone.service[97098]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:18:52.493050 dv-cinder-803823-11-smb devstack@keystone.service[97098]: spawned uWSGI master process (pid: 97098) Jun 16 00:18:52.493241 dv-cinder-803823-11-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 00:18:52.496089 dv-cinder-803823-11-smb devstack@keystone.service[97098]: spawned uWSGI worker 1 (pid: 97110, cores: 1) Jun 16 00:18:52.496089 dv-cinder-803823-11-smb devstack@keystone.service[97098]: spawned uWSGI worker 2 (pid: 97111, cores: 1) Jun 16 00:18:52.496089 dv-cinder-803823-11-smb devstack@keystone.service[97098]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:18:58.005736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:18:58.005736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: from cryptography.utils import int_from_bytes Jun 16 00:18:58.006800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:18:58.006800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: from cryptography.utils import int_from_bytes Jun 16 00:18:58.007221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:18:58.007221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: from cryptography.utils import int_from_bytes Jun 16 00:18:58.007338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:18:58.007338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: from cryptography.utils import int_from_bytes Jun 16 00:18:58.060965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:18:58.061603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:18:58.061693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:18:58.061784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:18:58.061849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] command line args: [] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:18:58.061911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] command line args: [] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:18:58.061972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:18:58.062033 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:18:58.062096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ================================================================================ {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:18:58.062158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ================================================================================ {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:18:58.062215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] admin_token = **** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.062275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] admin_token = **** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.062458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] config_dir = [] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.062548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] config_dir = [] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.062628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.062702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.062776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] config_source = [] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.062850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] config_source = [] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.062923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] debug = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.063002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] debug = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.063117 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.065062 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.065237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.065388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.065526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.065655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.065655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.065845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.065845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] list_limit = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] list_limit = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] log_config_append = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] log_config_append = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] log_dir = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066677 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] log_file = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] log_dir = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.066873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] log_file = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.067850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.068973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069377 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069687 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] publish_errors = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.069840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] publish_errors = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070542 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] standard_threads = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.070974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] standard_threads = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] use_journal = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] use_json = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] use_stderr = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] use_syslog = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] use_journal = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.071956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.072077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] use_json = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.072208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.072290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] use_stderr = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.072439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] use_syslog = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.072516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.072609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:18:58.072685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.072869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.072944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.073111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.073194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.073382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.073457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.073625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.073701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.073864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.073939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.074106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.074229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.074357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.074487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.074598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.074743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.074850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.074985 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.075100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.075237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.075351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.075478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.075590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.075754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.075866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.076004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.076108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.076245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.076358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.076505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.076611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.076762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.076840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.077011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.077088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.077252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.077327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.077509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.077624 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.077773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.077848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.078027 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.078103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.078280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.078357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.078515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.078590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.078752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.078831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.079022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.079698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.079823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.079916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.080022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.080106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.080243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.080326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.080495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.080570 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.080730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.080803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.080967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.081044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.081200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.081305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.081450 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.081559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.081699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.081808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.081936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.082044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.082175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.082293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.082408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.082525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.082639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.082714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.082857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.082943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.083097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.083223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.083331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.083406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.083565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.083648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.083825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.083907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.084061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.084135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.084301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.084389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.084534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.084610 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.084771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.084847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.085003 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.085084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.085244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.085327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.085476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.085551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.085717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.085798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.085950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.086028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.086187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.086261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.086424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.086504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.086660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.086735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.086897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.086993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.087129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.087211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.087363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.087446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.087599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.087674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.087864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.087940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.091997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092597 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.092971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.093939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094012 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.094873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.095477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.095556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.095639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.095711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.095794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.095859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.095921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.095983 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.096939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.097015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.097185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.097272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.097427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.097503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.097679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.097755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.097921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.098005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.098165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] auth.external = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.098240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.098405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.098708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.098945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.099181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] auth.password = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.099416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] auth.token = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.099658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.099944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.185030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.185346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.185617 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] auth.external = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.185883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.186214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.186294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.186472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.186603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.186727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] auth.password = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.186900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.186991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] auth.token = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.187182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.187262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.187438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.187516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.187700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] credential.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.187817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.187980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.188059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.188247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.188325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.188541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.188622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.188793 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.188869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.189043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] credential.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.189122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.189291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.189368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.189555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.189631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.189815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.189892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.190063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.190142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.190320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.190404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.190566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.190643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.190828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.190907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.191135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.191255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.191391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.191505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.191667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.191794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.191924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] federation.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.192095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.192173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.192354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.192444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.192629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.192706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.192881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.192957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.193136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.193221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.193380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] federation.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.193456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.193625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.193702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.193873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.193956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.194131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.194207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.194373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.194450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.194626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.194709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.194871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.194947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.195126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.195202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.195375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.195459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.195620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.195695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.195898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.195975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.196155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.196243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.196399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.196476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.196649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.196725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.196903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.196987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.197151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.197227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.197390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.197465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.197631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.197715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.197870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.197945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.198117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.198193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.198372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.198456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.198708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.198783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.198970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.199060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.199209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.199289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.199448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.199526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.199701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.199807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.199982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.200068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.200225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.200301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.200469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.200546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.200708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.200786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.200956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.201033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.201207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.201283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.201452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.201530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.201690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.201765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.201932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.202007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.202167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.202252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.202409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.202492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.202657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.202735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.202903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.202982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.203155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.203231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.203391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.203467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.203631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.203709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.203894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.203971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.204654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.204745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.204910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.205016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.205165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.205275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.205406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.205523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.205651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.205770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.205889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.206026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.206134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.206284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.206369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.206522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.206618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.206760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.206862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.207016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.207101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.207269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.207350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.207512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.207588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.207774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.207869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.208020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.208099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.208258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.208335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.208503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.208588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.208770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.208855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.209009 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.209086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.209248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.209331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.209487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.209564 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.209733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.209810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.209972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.210057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.210209 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.210286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.210501 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.210618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.210744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.210835 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.210993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.211081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.211222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.211301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.211457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.211544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.211701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.211797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.211965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.212046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.212208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.212297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.212446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.212523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.212686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.212761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.212938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.213016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.213179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.213256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.213423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.213499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.213665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.213750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.213898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.213980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.214147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.214224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.214389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.214467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.214631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.214708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.214873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.214955 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.215113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.215191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.215368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.215452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.215609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.215686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.215876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.215952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.216111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.216187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.216344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.216420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.216597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.216778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.216861 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.216931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.217065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.217143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.217304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.217383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] resource.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.217558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.217642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.217807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.217884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.218043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.218121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.218287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.218363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.218532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] resource.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.218615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.218773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.218851 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.219029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.219106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.219268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.219351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.219511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.219589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.220401 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] role.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.220494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.220658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.220734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] role.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.220908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.220986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.221148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.221264 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.221416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.221504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.221638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] role.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.221718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.221891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] role.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.221968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.222127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.222204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.222382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.222460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.222633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.222746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.222886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.222963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.223127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.223206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.223382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.223458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.223633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.223709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.227920 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228501 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.228980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.229956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] token.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.230938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] token.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.231940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.232083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.232184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.232289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.232442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.232546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.232681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.232790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.232932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.233091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.233268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.233349 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.233538 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.connection = **** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.233621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.233793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.233872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.234029 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.234154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.234279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.234358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.234526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.234602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.234770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.234846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.connection = **** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.235014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.235104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.235255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.235336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.235538 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.235616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.235817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.235978 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.236054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.236124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.236304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.236382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.236543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.236628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.236786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.236864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.237026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.237102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.237268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.237353 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.237504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.237581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.237747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.237824 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.237986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.238070 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.238163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:18:58.238241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.238465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.238705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.238950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.239193 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:18:58.239368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:18:58.268553 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.268720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.268947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.269482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.269721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.269953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.277701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.278548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.307356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.307565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.307754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.307997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.372337 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.372648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.422274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.422511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.424235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.424467 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.491683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.491932 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.492156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.492373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.492583 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.492669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.492794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.492878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.493032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.493253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.493471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.493688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.520053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.520233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.520384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.520469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.520620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.520714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.520843 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.520926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.521062 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.521145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.521281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.521364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.521608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.521827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.532292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.532857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.545670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.545803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.545887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.545992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.546105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.546207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.546390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.546475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.546549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.546701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.546863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.546995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.547122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.547248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:18:58.564400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.564607 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:18:58.565098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.565231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.565365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:18:58.565500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:18:58.565633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.565785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.565917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.566049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:18:58.566188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.566318 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.566448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.566589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.566765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.567025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.577046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.577320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.580222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.580222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.580368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.580368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.580368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.580368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.586629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.587452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.589912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.590192 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.590467 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.590742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.590827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.591013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.591094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.591266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.591357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.591531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.591613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.591823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.591955 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.592085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.592224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.592351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.592494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.592612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.592766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.593036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.593310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.593577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.618898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.620096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.620521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.620796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.621816 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.622095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.626488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.626772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.627077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.627907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.628190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.628473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.634714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.634994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.636190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.636472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.639435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.639719 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.640021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.640299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.640570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.640842 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.640922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.641107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.641191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.641371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.641453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.642285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.642562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.642837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.643110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.643379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.661425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.661704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.662023 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.662304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.666214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.666856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.669852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.670142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.670523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.670819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.675277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.675986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.678881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.679581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.682534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.682853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.683133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.683228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.683414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.683497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.683686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.683783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.683982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.684078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.684333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.684610 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.705312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.705587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.705849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.706047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.706130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.706331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.706598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.706863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.713914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.714703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.715604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.715918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.716438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.716726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.719049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.719338 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.719626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.719920 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.720064 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.720193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.720318 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.720481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.720778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.721061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.733412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.733686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.733972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.734238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.734380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.734509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.734635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.734761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.734945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.735075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.735229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.735539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.735839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.736120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.753396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.754725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.756910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.758254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.760203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.761573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.761788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.763158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.763548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.763865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.764145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.764968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.765258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.765544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.771947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.773351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.773490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.774974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.776714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.776999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.777275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.777545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.778202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.778491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.778777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.779052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.786689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.786975 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.787254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.788287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.788576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.788857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.795045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.795320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.795594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.795887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.796167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.796456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.796689 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:18:58.796818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.796966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.797117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.797241 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.797366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.797501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.797634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.797780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.798423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.798594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.798699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.798867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.798949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.799140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.799223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.799512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.799807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.800086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.800367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.800638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.800902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:18:58.836946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652d8b159c0 pid: 97110 (default app) Jun 16 00:18:58.838757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652d8b159c0 pid: 97111 (default app) Jun 16 00:18:58.840361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645f93-90bd-42b0-b651-2daf63f8505c None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:58.840655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645f93-90bd-42b0-b651-2daf63f8505c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:58.840928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645f93-90bd-42b0-b651-2daf63f8505c None None] PATH_INFO: `/v3` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:58.845249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Thu Jun 16 00:18:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:07.353876 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1159bf-3892-4b8e-8c29-2a0bf6fd8d1f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:07.354415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1159bf-3892-4b8e-8c29-2a0bf6fd8d1f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:07.354415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1159bf-3892-4b8e-8c29-2a0bf6fd8d1f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:07.358785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:07.364484 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:07.364926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:07.365042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:07.435743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: INFO dbcounter [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] Registered counter for database keystone Jun 16 00:19:07.456474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG oslo_db.sqlalchemy.engines [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:19:07.462816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writer thread running {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:19:07.639619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG passlib.handlers.bcrypt [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=97110) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 00:19:07.639986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG passlib.handlers.bcrypt [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97110) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 00:19:07.693943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:07.695539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:07.817255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 00:19:07.948390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1159bf-3892-4b8e-8c29-2a0bf6fd8d1f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:08.018048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: INFO dbcounter [None req-bf1159bf-3892-4b8e-8c29-2a0bf6fd8d1f None None] Registered counter for database keystone Jun 16 00:19:08.037791 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG oslo_db.sqlalchemy.engines [None req-bf1159bf-3892-4b8e-8c29-2a0bf6fd8d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:19:08.046917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writer thread running {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:19:08.164724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1159bf-3892-4b8e-8c29-2a0bf6fd8d1f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:08.169014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a74704-a513-4094-9fd4-5859e6fe02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:08.169682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a74704-a513-4094-9fd4-5859e6fe02bf admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:08.169962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a74704-a513-4094-9fd4-5859e6fe02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:08.170238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a74704-a513-4094-9fd4-5859e6fe02bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:08.178451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a74704-a513-4094-9fd4-5859e6fe02bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:08.230367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WARNING keystone.common.rbac_enforcer.enforcer [None req-95a74704-a513-4094-9fd4-5859e6fe02bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 00:19:08.230653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a74704-a513-4094-9fd4-5859e6fe02bf admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:08.240149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Jun 16 00:19:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:19:08.246142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:08.261545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6ee84-e46f-4ff5-8728-ec0df13d8f20 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:08.266016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db8399-4293-42ff-966a-3fb45b2d11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:08.267811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db8399-4293-42ff-966a-3fb45b2d11a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:08.268101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db8399-4293-42ff-966a-3fb45b2d11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:08.268387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db8399-4293-42ff-966a-3fb45b2d11a7 admin admin] PATH_INFO: `/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:08.269888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db8399-4293-42ff-966a-3fb45b2d11a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3ad4439044a4113a3a2bd5f12c4d6da)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:08.321111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WARNING keystone.common.rbac_enforcer.enforcer [None req-79db8399-4293-42ff-966a-3fb45b2d11a7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 00:19:08.321457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db8399-4293-42ff-966a-3fb45b2d11a7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:08.326167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Thu Jun 16 00:19:08 2022] GET /identity/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:10.421076 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b792-955c-4bf1-8337-a8880ca5125a None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.421623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b792-955c-4bf1-8337-a8880ca5125a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.421623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b792-955c-4bf1-8337-a8880ca5125a None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.426400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:10.431869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228a8c-b3c2-44d6-a902-e6e91b2986ef None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.432255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228a8c-b3c2-44d6-a902-e6e91b2986ef None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.432420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228a8c-b3c2-44d6-a902-e6e91b2986ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.450732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-6b228a8c-b3c2-44d6-a902-e6e91b2986ef None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:10.452367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-6b228a8c-b3c2-44d6-a902-e6e91b2986ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:10.460112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 00:19:10.482467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b792-955c-4bf1-8337-a8880ca5125a None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:10.495035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b792-955c-4bf1-8337-a8880ca5125a None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:10.499245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5616f12-8a45-4110-966c-426a93bb6e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:10.499903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5616f12-8a45-4110-966c-426a93bb6e28 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.500195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5616f12-8a45-4110-966c-426a93bb6e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.500510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5616f12-8a45-4110-966c-426a93bb6e28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.508369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5616f12-8a45-4110-966c-426a93bb6e28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:10.510133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5616f12-8a45-4110-966c-426a93bb6e28 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:10.518780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Jun 16 00:19:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:19:10.523979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b228a8c-b3c2-44d6-a902-e6e91b2986ef None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:10.533297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b228a8c-b3c2-44d6-a902-e6e91b2986ef None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:10.537684 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6058f-8fa2-4871-97d3-e06d3fd422db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:10.538534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6058f-8fa2-4871-97d3-e06d3fd422db admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.538817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6058f-8fa2-4871-97d3-e06d3fd422db admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.539096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6058f-8fa2-4871-97d3-e06d3fd422db admin admin] PATH_INFO: `/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.540510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6058f-8fa2-4871-97d3-e06d3fd422db admin admin] RBAC: Authorizing `identity:get_user(user_id=b772abf551ba4a3bbcb1567e3ad5b88c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:10.542337 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6058f-8fa2-4871-97d3-e06d3fd422db admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:10.543921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Thu Jun 16 00:19:10 2022] GET /identity/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:12.681361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2d0f9-aa18-428b-98db-b625c19b4b27 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.681919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2d0f9-aa18-428b-98db-b625c19b4b27 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.681919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2d0f9-aa18-428b-98db-b625c19b4b27 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.683294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:12.689236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1088-7038-4884-8275-c6e52bc4f978 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.689743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1088-7038-4884-8275-c6e52bc4f978 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.689887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1088-7038-4884-8275-c6e52bc4f978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.709031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a34a1088-7038-4884-8275-c6e52bc4f978 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:12.710244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a34a1088-7038-4884-8275-c6e52bc4f978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:12.753353 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65e13-44d3-44a7-bb2a-f5ca1ad1e8c9 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.753647 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65e13-44d3-44a7-bb2a-f5ca1ad1e8c9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.753926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b65e13-44d3-44a7-bb2a-f5ca1ad1e8c9 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.755463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:12.760686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5917-7ac8-4ef8-ac01-276f0f58e847 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.760967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5917-7ac8-4ef8-ac01-276f0f58e847 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.761245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5917-7ac8-4ef8-ac01-276f0f58e847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.790477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:12.801721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG passlib.handlers.bcrypt [None req-bb5a5917-7ac8-4ef8-ac01-276f0f58e847 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=97111) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 00:19:12.802149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG passlib.handlers.bcrypt [None req-bb5a5917-7ac8-4ef8-ac01-276f0f58e847 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97111) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 00:19:12.813210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a1088-7038-4884-8275-c6e52bc4f978 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:12.835654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:12.847448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-bb5a5917-7ac8-4ef8-ac01-276f0f58e847 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:12.849043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-bb5a5917-7ac8-4ef8-ac01-276f0f58e847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:12.913443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a1088-7038-4884-8275-c6e52bc4f978 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:12.946363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f69d-84c9-4a29-98b0-876d74ab5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:12.947098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f69d-84c9-4a29-98b0-876d74ab5564 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.947392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f69d-84c9-4a29-98b0-876d74ab5564 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.947672 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f69d-84c9-4a29-98b0-876d74ab5564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.948740 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:12.959133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f69d-84c9-4a29-98b0-876d74ab5564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-9711f69d-84c9-4a29-98b0-876d74ab5564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:12.970854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:12.971945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:12.972781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:12.973369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a5917-7ac8-4ef8-ac01-276f0f58e847 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:12.973437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:19:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:19:12.977555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f69d-84c9-4a29-98b0-876d74ab5564 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:13.060943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:13.072484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a5917-7ac8-4ef8-ac01-276f0f58e847 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:13.074887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:13.078152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f69d-84c9-4a29-98b0-876d74ab5564 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:13.111571 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1319e-63b1-4bef-ae37-43d8887f3b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:13.111948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1664a4-849b-4559-9182-2a0e38c63afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:13.112494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1319e-63b1-4bef-ae37-43d8887f3b0a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.112601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1664a4-849b-4559-9182-2a0e38c63afd None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.112877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1664a4-849b-4559-9182-2a0e38c63afd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.112971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1319e-63b1-4bef-ae37-43d8887f3b0a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.113152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1664a4-849b-4559-9182-2a0e38c63afd None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.113255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1319e-63b1-4bef-ae37-43d8887f3b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.113896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1664a4-849b-4559-9182-2a0e38c63afd None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:13.114205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1664a4-849b-4559-9182-2a0e38c63afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:13.115608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1664a4-849b-4559-9182-2a0e38c63afd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:13.127082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:13.132849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1664a4-849b-4559-9182-2a0e38c63afd None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:13.182580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1319e-63b1-4bef-ae37-43d8887f3b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:13.184123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1319e-63b1-4bef-ae37-43d8887f3b0a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:13.230161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1664a4-849b-4559-9182-2a0e38c63afd None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:13.265072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a7131-a121-424c-9492-b7bb9e208a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:13.265936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a7131-a121-424c-9492-b7bb9e208a33 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.266722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a7131-a121-424c-9492-b7bb9e208a33 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.267002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a7131-a121-424c-9492-b7bb9e208a33 None admin] PATH_INFO: `/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.268265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a7131-a121-424c-9492-b7bb9e208a33 None admin] RBAC: Authorizing `identity:get_user(user_id=b772abf551ba4a3bbcb1567e3ad5b88c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:13.269731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a7131-a121-424c-9492-b7bb9e208a33 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:13.271323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 9/16] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:13 2022] GET /identity/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:13.276585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a7131-a121-424c-9492-b7bb9e208a33 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:13.284426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 8/17] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:19:13.289775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1319e-63b1-4bef-ae37-43d8887f3b0a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:13.291268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:13.292482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:13.374063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a7131-a121-424c-9492-b7bb9e208a33 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:13.386025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1319e-63b1-4bef-ae37-43d8887f3b0a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:13.408157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab603-a094-4bff-afdd-70b7de72639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:13.408964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab603-a094-4bff-afdd-70b7de72639a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.409235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab603-a094-4bff-afdd-70b7de72639a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.409517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab603-a094-4bff-afdd-70b7de72639a None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.410808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ab603-a094-4bff-afdd-70b7de72639a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:13.412314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ab603-a094-4bff-afdd-70b7de72639a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:13.414079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:13.419167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68901b21-2f25-4d36-8e75-6afe97df8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:13.419669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab603-a094-4bff-afdd-70b7de72639a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:13.419980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68901b21-2f25-4d36-8e75-6afe97df8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.420261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68901b21-2f25-4d36-8e75-6afe97df8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.420528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68901b21-2f25-4d36-8e75-6afe97df8fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.438989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68901b21-2f25-4d36-8e75-6afe97df8fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:13.440493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68901b21-2f25-4d36-8e75-6afe97df8fa7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-68901b21-2f25-4d36-8e75-6afe97df8fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:19:13.461500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:13.462308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:13.463081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:19:13.463081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:19:13.463081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:19:13.463081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:13.463081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:19:13.468414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68901b21-2f25-4d36-8e75-6afe97df8fa7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:13.499140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:13.519279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab603-a094-4bff-afdd-70b7de72639a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:13.525147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:13.554715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66846ddb-7038-488c-812a-033b9005809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:13.555368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846ddb-7038-488c-812a-033b9005809b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.555650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846ddb-7038-488c-812a-033b9005809b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.555955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846ddb-7038-488c-812a-033b9005809b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.556775 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66846ddb-7038-488c-812a-033b9005809b None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.domain.id=default, user.id=b772abf551ba4a3bbcb1567e3ad5b88c) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:13.557080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66846ddb-7038-488c-812a-033b9005809b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:13.558519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66846ddb-7038-488c-812a-033b9005809b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:13.565499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Jun 16 00:19:13 2022] GET /identity/v3/role_assignments?user.id=b772abf551ba4a3bbcb1567e3ad5b88c&scope.domain.id=default&role.id=635caa85d8524fb887206fd521defd3f => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:13.568502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68901b21-2f25-4d36-8e75-6afe97df8fa7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:13.604054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd48a0-2154-4e65-98c4-122b2e9ef4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:13.604722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd48a0-2154-4e65-98c4-122b2e9ef4a3 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.605006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd48a0-2154-4e65-98c4-122b2e9ef4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.605284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd48a0-2154-4e65-98c4-122b2e9ef4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.606017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd48a0-2154-4e65-98c4-122b2e9ef4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:13.606325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd48a0-2154-4e65-98c4-122b2e9ef4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:13.607799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd48a0-2154-4e65-98c4-122b2e9ef4a3 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:13.627981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:16.063387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334522d-790b-414c-82fc-17e32448c013 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:16.064370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334522d-790b-414c-82fc-17e32448c013 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:16.064839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334522d-790b-414c-82fc-17e32448c013 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:16.066402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:16.080756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b8bf-efde-4098-892c-5eb2440b25a5 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:16.081614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b8bf-efde-4098-892c-5eb2440b25a5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:16.082085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b8bf-efde-4098-892c-5eb2440b25a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:16.087081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef48b2-3cf5-4d20-ae99-f32126bce46e None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:16.087588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef48b2-3cf5-4d20-ae99-f32126bce46e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:16.088079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef48b2-3cf5-4d20-ae99-f32126bce46e None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:16.089638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 13/23] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:16.095077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e5d61-a8d0-4d1e-a493-0820d46ca975 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:16.095571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e5d61-a8d0-4d1e-a493-0820d46ca975 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:16.096058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e5d61-a8d0-4d1e-a493-0820d46ca975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:16.122535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3a93b8bf-efde-4098-892c-5eb2440b25a5 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:16.123758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4a5e5d61-a8d0-4d1e-a493-0820d46ca975 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:16.125142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4a5e5d61-a8d0-4d1e-a493-0820d46ca975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:16.126546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3a93b8bf-efde-4098-892c-5eb2440b25a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:16.268149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:16.270170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e0db-8ac4-4268-80b5-5f4e72456d25 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:16.275875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 14/25] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:16.276429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e0db-8ac4-4268-80b5-5f4e72456d25 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:16.276912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e0db-8ac4-4268-80b5-5f4e72456d25 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:16.278744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 12/26] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:16.298067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecf9fb-9cae-4452-ac59-8fc48b8d4961 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:16.298320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecf9fb-9cae-4452-ac59-8fc48b8d4961 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:16.298577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecf9fb-9cae-4452-ac59-8fc48b8d4961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:16.305087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210e0db-8ac4-4268-80b5-5f4e72456d25 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:16.330322 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ffecf9fb-9cae-4452-ac59-8fc48b8d4961 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:16.332774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ffecf9fb-9cae-4452-ac59-8fc48b8d4961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:16.397449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:16.441262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:16.442553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecf9fb-9cae-4452-ac59-8fc48b8d4961 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:16.449019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:16.501249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210e0db-8ac4-4268-80b5-5f4e72456d25 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:16.569692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92864b68-504c-45c1-88b6-421091a1c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:16.571426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92864b68-504c-45c1-88b6-421091a1c624 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:16.572657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92864b68-504c-45c1-88b6-421091a1c624 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:16.573273 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92864b68-504c-45c1-88b6-421091a1c624 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:16.576628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92864b68-504c-45c1-88b6-421091a1c624 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:16.578050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92864b68-504c-45c1-88b6-421091a1c624 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:16.589078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecf9fb-9cae-4452-ac59-8fc48b8d4961 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:16.628591 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6bd49-81f0-4ccb-8ae6-974e55c7299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:16.629748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6bd49-81f0-4ccb-8ae6-974e55c7299a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:16.630252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6bd49-81f0-4ccb-8ae6-974e55c7299a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:16.630728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6bd49-81f0-4ccb-8ae6-974e55c7299a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:16.643586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6bd49-81f0-4ccb-8ae6-974e55c7299a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:16.645597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6bd49-81f0-4ccb-8ae6-974e55c7299a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-7ff6bd49-81f0-4ccb-8ae6-974e55c7299a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:19:16.666060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:16.666883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:16.668310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:19:16.668310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:19:16.668310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:19:16.668310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:16.670110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 16/28] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:16.671343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6bd49-81f0-4ccb-8ae6-974e55c7299a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:16.737342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:16.794347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6bd49-81f0-4ccb-8ae6-974e55c7299a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:16.850311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 13/29] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 16 00:19:16 2022] POST /identity/v3/roles => generated 219 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:16.851220 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92864b68-504c-45c1-88b6-421091a1c624 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:16.876461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ded2f9-854d-4f97-b8b4-5fd95861b573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:16.877274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ded2f9-854d-4f97-b8b4-5fd95861b573 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:16.877555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ded2f9-854d-4f97-b8b4-5fd95861b573 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:16.877827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ded2f9-854d-4f97-b8b4-5fd95861b573 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:16.905526 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ded2f9-854d-4f97-b8b4-5fd95861b573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-08ded2f9-854d-4f97-b8b4-5fd95861b573 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:16.916335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:16.920838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:16.921576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 17/30] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:19:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:16.922914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ded2f9-854d-4f97-b8b4-5fd95861b573 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:17.139890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92864b68-504c-45c1-88b6-421091a1c624 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:17.148240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ded2f9-854d-4f97-b8b4-5fd95861b573 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:17.149934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:17.168239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:17.193133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fbba5-359d-4151-b183-1debc1ce2a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:17.193813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fbba5-359d-4151-b183-1debc1ce2a8f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.194099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fbba5-359d-4151-b183-1debc1ce2a8f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.194380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fbba5-359d-4151-b183-1debc1ce2a8f None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.195112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fbba5-359d-4151-b183-1debc1ce2a8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:17.195422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fbba5-359d-4151-b183-1debc1ce2a8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:17.196987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fbba5-359d-4151-b183-1debc1ce2a8f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:17.199376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8f963-fb7b-41db-b61d-411e7f50cf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:17.201230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8f963-fb7b-41db-b61d-411e7f50cf32 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.201740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8f963-fb7b-41db-b61d-411e7f50cf32 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.202207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8f963-fb7b-41db-b61d-411e7f50cf32 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.203156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8f963-fb7b-41db-b61d-411e7f50cf32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:17.204352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8f963-fb7b-41db-b61d-411e7f50cf32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:17.205956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8f963-fb7b-41db-b61d-411e7f50cf32 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:17.214344 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 14/31] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:17.215582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 18/32] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:17.216140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f119-91a1-4725-a6a4-487bffc78d34 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.216556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f119-91a1-4725-a6a4-487bffc78d34 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.216952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f119-91a1-4725-a6a4-487bffc78d34 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.218603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 15/33] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:17.221393 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8f963-fb7b-41db-b61d-411e7f50cf32 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:17.223650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230f119-91a1-4725-a6a4-487bffc78d34 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:17.342842 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8f963-fb7b-41db-b61d-411e7f50cf32 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:17.352226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230f119-91a1-4725-a6a4-487bffc78d34 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:17.394867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f61f0-2ae4-4873-bc75-36c8dd29a9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:17.395524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f61f0-2ae4-4873-bc75-36c8dd29a9cc None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.395859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f61f0-2ae4-4873-bc75-36c8dd29a9cc None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.396143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f61f0-2ae4-4873-bc75-36c8dd29a9cc None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.397276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f61f0-2ae4-4873-bc75-36c8dd29a9cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:17.397791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad718-8d1c-444b-adea-4521d73b35ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:17.398840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f61f0-2ae4-4873-bc75-36c8dd29a9cc None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:17.399110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad718-8d1c-444b-adea-4521d73b35ee None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.399586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad718-8d1c-444b-adea-4521d73b35ee None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.400079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad718-8d1c-444b-adea-4521d73b35ee None admin] PATH_INFO: `/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.401591 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad718-8d1c-444b-adea-4521d73b35ee None admin] RBAC: Authorizing `identity:get_user(user_id=b772abf551ba4a3bbcb1567e3ad5b88c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:17.404046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad718-8d1c-444b-adea-4521d73b35ee None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:17.405922 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 19/34] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:17 2022] GET /identity/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:17.407415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42e48a-b9a9-480e-bf65-772f25268d77 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.407925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42e48a-b9a9-480e-bf65-772f25268d77 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.408999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42e48a-b9a9-480e-bf65-772f25268d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.426492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-2e42e48a-b9a9-480e-bf65-772f25268d77 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:17.427673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2e42e48a-b9a9-480e-bf65-772f25268d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:17.469508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:17.493323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 20/35] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:17.494653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209fe3c-6a3f-4413-b01f-181b5565e4c3 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.494950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209fe3c-6a3f-4413-b01f-181b5565e4c3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.495230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209fe3c-6a3f-4413-b01f-181b5565e4c3 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.496673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 21/36] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:17.497223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209fe3c-6a3f-4413-b01f-181b5565e4c3 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:17.523782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 16/37] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:19:17 2022] POST /identity/v3/projects => generated 301 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:17.523782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819a313-65f9-416e-8897-802952380724 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.524179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819a313-65f9-416e-8897-802952380724 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.524685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819a313-65f9-416e-8897-802952380724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.544881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-5819a313-65f9-416e-8897-802952380724 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:17.546525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5819a313-65f9-416e-8897-802952380724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:17.562602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:17.632830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 17/38] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:17.634324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819a313-65f9-416e-8897-802952380724 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:17.648759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209fe3c-6a3f-4413-b01f-181b5565e4c3 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:17.694725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c631432-650e-4a2b-88d6-9ac644322a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:17.695482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631432-650e-4a2b-88d6-9ac644322a18 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.695792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631432-650e-4a2b-88d6-9ac644322a18 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.696075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631432-650e-4a2b-88d6-9ac644322a18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.697277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c631432-650e-4a2b-88d6-9ac644322a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:17.698758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c631432-650e-4a2b-88d6-9ac644322a18 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:17.701383 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 22/39] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:17.701980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c631432-650e-4a2b-88d6-9ac644322a18 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:17.777427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819a313-65f9-416e-8897-802952380724 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:17.782854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:17.815476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a6ab3-d37e-414e-b7b1-e0ed862a327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:17.816183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6ab3-d37e-414e-b7b1-e0ed862a327d None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.816473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6ab3-d37e-414e-b7b1-e0ed862a327d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.816757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6ab3-d37e-414e-b7b1-e0ed862a327d None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.817541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a6ab3-d37e-414e-b7b1-e0ed862a327d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:17.818930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a6ab3-d37e-414e-b7b1-e0ed862a327d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:17.837156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c631432-650e-4a2b-88d6-9ac644322a18 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:17.870085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3aba3-55b3-47b0-bb26-6e540dabe2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:17.870745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3aba3-55b3-47b0-bb26-6e540dabe2a7 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.871026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3aba3-55b3-47b0-bb26-6e540dabe2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.871304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3aba3-55b3-47b0-bb26-6e540dabe2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.872068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3aba3-55b3-47b0-bb26-6e540dabe2a7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:17.873505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3aba3-55b3-47b0-bb26-6e540dabe2a7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:17.890950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 18/40] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 16 00:19:17 2022] POST /identity/v3/roles => generated 225 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:17.891752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a6ab3-d37e-414e-b7b1-e0ed862a327d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:18.015263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:18.126982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a6ab3-d37e-414e-b7b1-e0ed862a327d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:18.160851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2225c-d510-4db1-a96a-ec1918bbed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:18.161721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2225c-d510-4db1-a96a-ec1918bbed68 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:18.162006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2225c-d510-4db1-a96a-ec1918bbed68 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:18.162284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2225c-d510-4db1-a96a-ec1918bbed68 None admin] PATH_INFO: `/v3/domains/default/users/b772abf551ba4a3bbcb1567e3ad5b88c/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:18.164518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2225c-d510-4db1-a96a-ec1918bbed68 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b772abf551ba4a3bbcb1567e3ad5b88c, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:18.165964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2225c-d510-4db1-a96a-ec1918bbed68 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:18.169934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 23/41] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 16 00:19:17 2022] POST /identity/v3/roles => generated 223 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:18.171464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa852b-b90a-4a57-9609-4d1cb69694c2 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:18.171782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa852b-b90a-4a57-9609-4d1cb69694c2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:18.172126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa852b-b90a-4a57-9609-4d1cb69694c2 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:18.173907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 24/42] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:18.179627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d772c9-65c5-4456-b662-600af9a4fa80 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:18.179939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d772c9-65c5-4456-b662-600af9a4fa80 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:18.180219 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d772c9-65c5-4456-b662-600af9a4fa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:18.199211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-96d772c9-65c5-4456-b662-600af9a4fa80 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:18.200821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-96d772c9-65c5-4456-b662-600af9a4fa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:18.229158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 19/43] 10.222.0.27 () {58 vars in 1361 bytes} [Thu Jun 16 00:19:17 2022] PUT /identity/v3/domains/default/users/b772abf551ba4a3bbcb1567e3ad5b88c/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:19:18.280349 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 25/44] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:18.304643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2225c-d510-4db1-a96a-ec1918bbed68 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:18.381013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:18.417301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2225c-d510-4db1-a96a-ec1918bbed68 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:18.451392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a5694-d28a-459b-a164-cb9f9ca69bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:18.452475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a5694-d28a-459b-a164-cb9f9ca69bb1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:18.453211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a5694-d28a-459b-a164-cb9f9ca69bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:18.454005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a5694-d28a-459b-a164-cb9f9ca69bb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:18.455199 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a5694-d28a-459b-a164-cb9f9ca69bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:18.456706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a5694-d28a-459b-a164-cb9f9ca69bb1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:18.458345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 20/45] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:18.463894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d772c9-65c5-4456-b662-600af9a4fa80 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:18.496939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:18.562371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d772c9-65c5-4456-b662-600af9a4fa80 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:18.595669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8e675-616b-4c9f-9b8f-90756f1fb192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:18.596357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8e675-616b-4c9f-9b8f-90756f1fb192 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:18.596645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8e675-616b-4c9f-9b8f-90756f1fb192 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:18.596926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8e675-616b-4c9f-9b8f-90756f1fb192 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:18.597640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8e675-616b-4c9f-9b8f-90756f1fb192 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:18.599242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8e675-616b-4c9f-9b8f-90756f1fb192 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:18.710144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 26/46] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:19:18 2022] POST /identity/v3/projects => generated 312 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:20.338666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc49a9-7713-4132-832e-0d301fd61fb3 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:20.339195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc49a9-7713-4132-832e-0d301fd61fb3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:20.339279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc49a9-7713-4132-832e-0d301fd61fb3 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:20.340643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 21/47] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:20.345836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d45fbd-a0c2-48d4-8ab8-14c1eda86079 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:20.346236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d45fbd-a0c2-48d4-8ab8-14c1eda86079 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:20.346398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d45fbd-a0c2-48d4-8ab8-14c1eda86079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:20.362832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c9d45fbd-a0c2-48d4-8ab8-14c1eda86079 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:20.364063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c9d45fbd-a0c2-48d4-8ab8-14c1eda86079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:20.428496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 27/48] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:20.451423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc49a9-7713-4132-832e-0d301fd61fb3 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:20.550657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc49a9-7713-4132-832e-0d301fd61fb3 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:20.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d214a0-eb57-46ea-8670-faa721d76c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:20.584255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d214a0-eb57-46ea-8670-faa721d76c83 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:20.584545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d214a0-eb57-46ea-8670-faa721d76c83 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:20.584822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d214a0-eb57-46ea-8670-faa721d76c83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:20.588346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:20.596507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d214a0-eb57-46ea-8670-faa721d76c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-39d214a0-eb57-46ea-8670-faa721d76c83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:20.605372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:20.610730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:20.611511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 22/49] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:20.612939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d45fbd-a0c2-48d4-8ab8-14c1eda86079 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:20.630648 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:20.716426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d45fbd-a0c2-48d4-8ab8-14c1eda86079 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:20.751195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3390-75d8-4918-9e92-6afd6c3d940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:20.751930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3390-75d8-4918-9e92-6afd6c3d940f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:20.752222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3390-75d8-4918-9e92-6afd6c3d940f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:20.752505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3390-75d8-4918-9e92-6afd6c3d940f None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:20.753285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3390-75d8-4918-9e92-6afd6c3d940f None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:20.753600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3390-75d8-4918-9e92-6afd6c3d940f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:20.755081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3390-75d8-4918-9e92-6afd6c3d940f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:20.765155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 28/50] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:20.770882 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d214a0-eb57-46ea-8670-faa721d76c83 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:20.817380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ca43-c3a6-440b-bb0a-38754a37536d None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:20.817675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ca43-c3a6-440b-bb0a-38754a37536d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:20.817967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ca43-c3a6-440b-bb0a-38754a37536d None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:20.819353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 29/51] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:20.824450 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3a5e-5e46-406c-a48b-eba1e4ca16ff None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:20.824744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3a5e-5e46-406c-a48b-eba1e4ca16ff None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:20.825024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3a5e-5e46-406c-a48b-eba1e4ca16ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:20.842492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ed2e3a5e-5e46-406c-a48b-eba1e4ca16ff None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:20.843869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ed2e3a5e-5e46-406c-a48b-eba1e4ca16ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:20.876003 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d214a0-eb57-46ea-8670-faa721d76c83 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:20.909676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e50f93-c4aa-4e6b-baaa-8067a3b99fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:20.910549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e50f93-c4aa-4e6b-baaa-8067a3b99fd6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:20.913044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e50f93-c4aa-4e6b-baaa-8067a3b99fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:20.913044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e50f93-c4aa-4e6b-baaa-8067a3b99fd6 None admin] PATH_INFO: `/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:20.913235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 30/52] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:20.913310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e50f93-c4aa-4e6b-baaa-8067a3b99fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=b772abf551ba4a3bbcb1567e3ad5b88c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:20.913782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e50f93-c4aa-4e6b-baaa-8067a3b99fd6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:20.915422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 23/53] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:20 2022] GET /identity/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:20.920888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e3a5e-5e46-406c-a48b-eba1e4ca16ff None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:20.931512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:20.934528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e50f93-c4aa-4e6b-baaa-8067a3b99fd6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:20.997021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:21.020434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e3a5e-5e46-406c-a48b-eba1e4ca16ff None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:21.038091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e50f93-c4aa-4e6b-baaa-8067a3b99fd6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:21.056480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74ca4-4895-4384-a74d-f811c194456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:21.057272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74ca4-4895-4384-a74d-f811c194456a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:21.057557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74ca4-4895-4384-a74d-f811c194456a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:21.057833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74ca4-4895-4384-a74d-f811c194456a None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:21.059082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74ca4-4895-4384-a74d-f811c194456a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:21.060599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74ca4-4895-4384-a74d-f811c194456a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:21.062233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 31/54] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:21.067828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74ca4-4895-4384-a74d-f811c194456a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:21.071832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9300dc-0fdd-4026-a67b-17915a27848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:21.072623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9300dc-0fdd-4026-a67b-17915a27848d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:21.072908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9300dc-0fdd-4026-a67b-17915a27848d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:21.073185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9300dc-0fdd-4026-a67b-17915a27848d None admin] PATH_INFO: `/v3/domains/default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:21.074367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9300dc-0fdd-4026-a67b-17915a27848d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:21.075866 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9300dc-0fdd-4026-a67b-17915a27848d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:21.077660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 24/55] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:21.082691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9300dc-0fdd-4026-a67b-17915a27848d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:21.150658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:21.173832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74ca4-4895-4384-a74d-f811c194456a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:21.180616 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9300dc-0fdd-4026-a67b-17915a27848d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:21.208058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047db01-cf49-47f1-8ad3-3be118cf6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:21.208710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047db01-cf49-47f1-8ad3-3be118cf6a4f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:21.209000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047db01-cf49-47f1-8ad3-3be118cf6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:21.209112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:21.209278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047db01-cf49-47f1-8ad3-3be118cf6a4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:21.210113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047db01-cf49-47f1-8ad3-3be118cf6a4f None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.domain.id=default, user.id=b772abf551ba4a3bbcb1567e3ad5b88c) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:21.210427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047db01-cf49-47f1-8ad3-3be118cf6a4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:21.211921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047db01-cf49-47f1-8ad3-3be118cf6a4f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:21.214020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cd27d-a7f8-473c-a05d-81cde11c074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:21.214679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cd27d-a7f8-473c-a05d-81cde11c074d None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:21.214971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cd27d-a7f8-473c-a05d-81cde11c074d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:21.215260 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cd27d-a7f8-473c-a05d-81cde11c074d None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:21.216007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cd27d-a7f8-473c-a05d-81cde11c074d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:21.217463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cd27d-a7f8-473c-a05d-81cde11c074d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:21.217639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 32/56] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Jun 16 00:19:21 2022] GET /identity/v3/role_assignments?user.id=b772abf551ba4a3bbcb1567e3ad5b88c&scope.domain.id=default&role.id=635caa85d8524fb887206fd521defd3f => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:21.315476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 25/57] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Jun 16 00:19:21 2022] POST /identity/v3/projects => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:19:23.421460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32909bc-c37f-4770-a452-83a6d44df4b0 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:23.421968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32909bc-c37f-4770-a452-83a6d44df4b0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:23.422047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32909bc-c37f-4770-a452-83a6d44df4b0 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:23.423431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 33/58] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:23.428614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff027ed-0eca-478a-b6c9-8c68f5f46ff2 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:23.429047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff027ed-0eca-478a-b6c9-8c68f5f46ff2 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:23.429181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff027ed-0eca-478a-b6c9-8c68f5f46ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:23.445913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3ff027ed-0eca-478a-b6c9-8c68f5f46ff2 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:23.447081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3ff027ed-0eca-478a-b6c9-8c68f5f46ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:23.510448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 26/59] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:23.534811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32909bc-c37f-4770-a452-83a6d44df4b0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:23.633017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32909bc-c37f-4770-a452-83a6d44df4b0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:23.664738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1d08d-44da-4077-8a74-d102586014e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:23.665513 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1d08d-44da-4077-8a74-d102586014e0 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:23.665801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1d08d-44da-4077-8a74-d102586014e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:23.666080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1d08d-44da-4077-8a74-d102586014e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:23.667254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1d08d-44da-4077-8a74-d102586014e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:23.668743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1d08d-44da-4077-8a74-d102586014e0 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:23.670328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 34/60] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:23.676098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff027ed-0eca-478a-b6c9-8c68f5f46ff2 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:23.769996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff027ed-0eca-478a-b6c9-8c68f5f46ff2 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:23.783233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:23.802652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba458b-bd1e-4ab3-8fa8-ff2f96b43f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:23.803313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba458b-bd1e-4ab3-8fa8-ff2f96b43f27 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:23.803599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba458b-bd1e-4ab3-8fa8-ff2f96b43f27 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:23.803950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba458b-bd1e-4ab3-8fa8-ff2f96b43f27 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:23.804648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba458b-bd1e-4ab3-8fa8-ff2f96b43f27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:23.806092 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba458b-bd1e-4ab3-8fa8-ff2f96b43f27 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:23.936184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 27/61] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:19:23 2022] POST /identity/v3/users => generated 275 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:27.041772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debbce9-74a5-43f0-b93b-af4a48dad9e7 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.066806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debbce9-74a5-43f0-b93b-af4a48dad9e7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.066806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debbce9-74a5-43f0-b93b-af4a48dad9e7 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.066806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 35/62] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:27.067580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc1037-a0f8-4407-8323-fd4a4dc2172a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.067580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc1037-a0f8-4407-8323-fd4a4dc2172a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.067580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc1037-a0f8-4407-8323-fd4a4dc2172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.072727 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-18fc1037-a0f8-4407-8323-fd4a4dc2172a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:27.074159 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-18fc1037-a0f8-4407-8323-fd4a4dc2172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:27.162073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 28/63] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:27.185292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debbce9-74a5-43f0-b93b-af4a48dad9e7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:27.203211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:27.329254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debbce9-74a5-43f0-b93b-af4a48dad9e7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:27.378752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22576a4b-04ed-4dff-a8cb-3e227f2597ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:27.379568 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576a4b-04ed-4dff-a8cb-3e227f2597ac None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.379893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576a4b-04ed-4dff-a8cb-3e227f2597ac None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.380172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576a4b-04ed-4dff-a8cb-3e227f2597ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.400634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22576a4b-04ed-4dff-a8cb-3e227f2597ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-22576a4b-04ed-4dff-a8cb-3e227f2597ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:27.409043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:27.409972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:27.410731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 36/64] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:27.416330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc1037-a0f8-4407-8323-fd4a4dc2172a None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:27.425973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46680a72-2d52-4901-928b-006dcbbf20b2 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.426269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46680a72-2d52-4901-928b-006dcbbf20b2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.426520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46680a72-2d52-4901-928b-006dcbbf20b2 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.427966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 37/65] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:27.433651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc500e-4f34-4e07-914e-dd7082b30ee1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.434453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc500e-4f34-4e07-914e-dd7082b30ee1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.434453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc500e-4f34-4e07-914e-dd7082b30ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.459834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-80fc500e-4f34-4e07-914e-dd7082b30ee1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:27.461061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-80fc500e-4f34-4e07-914e-dd7082b30ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:27.552955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:27.555938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 38/66] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:27.557603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:27.558915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47263-b412-469e-bf1c-52740ff600cd None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.559410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47263-b412-469e-bf1c-52740ff600cd None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.559914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47263-b412-469e-bf1c-52740ff600cd None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.561048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc1037-a0f8-4407-8323-fd4a4dc2172a None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:27.561815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 39/67] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:27.569880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510e37d-6db1-4664-9906-102030d3c776 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.569880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510e37d-6db1-4664-9906-102030d3c776 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.574999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510e37d-6db1-4664-9906-102030d3c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.596447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-6510e37d-6db1-4664-9906-102030d3c776 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:27.597744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-6510e37d-6db1-4664-9906-102030d3c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:27.614862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949811d5-d134-4194-ab5c-b8f507aa0076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:27.615634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949811d5-d134-4194-ab5c-b8f507aa0076 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.615904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949811d5-d134-4194-ab5c-b8f507aa0076 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.616151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949811d5-d134-4194-ab5c-b8f507aa0076 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.616948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949811d5-d134-4194-ab5c-b8f507aa0076 None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:27.617263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949811d5-d134-4194-ab5c-b8f507aa0076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:27.618655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949811d5-d134-4194-ab5c-b8f507aa0076 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:27.630231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 29/68] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:27.635757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949811d5-d134-4194-ab5c-b8f507aa0076 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:27.673441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 40/69] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:27.677708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1aaac-2fae-4591-ac88-a9549f0603ef None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.678659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1aaac-2fae-4591-ac88-a9549f0603ef None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.679144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1aaac-2fae-4591-ac88-a9549f0603ef None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.681386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 41/70] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:27.682281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1aaac-2fae-4591-ac88-a9549f0603ef None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:27.745796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949811d5-d134-4194-ab5c-b8f507aa0076 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:27.785334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21c8a5-fd35-4266-8539-d0202aa7863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:27.786158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21c8a5-fd35-4266-8539-d0202aa7863c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.786442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21c8a5-fd35-4266-8539-d0202aa7863c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.786718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21c8a5-fd35-4266-8539-d0202aa7863c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.799079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21c8a5-fd35-4266-8539-d0202aa7863c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:27.804280 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1aaac-2fae-4591-ac88-a9549f0603ef None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-ff21c8a5-fd35-4266-8539-d0202aa7863c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:27.807230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:27.808375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:27.809111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 30/71] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:27.809713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d646d-37d3-483e-b3c1-d59eac873c67 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.810487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d646d-37d3-483e-b3c1-d59eac873c67 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.815249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d646d-37d3-483e-b3c1-d59eac873c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.832183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:27.834161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c14d646d-37d3-483e-b3c1-d59eac873c67 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:27.835372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c14d646d-37d3-483e-b3c1-d59eac873c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:27.839625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a53b-07a5-4b17-9645-21d58e406564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:27.843761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a53b-07a5-4b17-9645-21d58e406564 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.843761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a53b-07a5-4b17-9645-21d58e406564 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.843761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a53b-07a5-4b17-9645-21d58e406564 None admin] PATH_INFO: `/v3/users/eaba8e0151814990a7ea9b84d6461ffd` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.852111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:27.854491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606a53b-07a5-4b17-9645-21d58e406564 None admin] RBAC: Authorizing `identity:get_user(user_id=eaba8e0151814990a7ea9b84d6461ffd)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:27.855995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606a53b-07a5-4b17-9645-21d58e406564 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:27.862039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 42/72] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:27 2022] GET /identity/v3/users/eaba8e0151814990a7ea9b84d6461ffd => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:27.862039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a53b-07a5-4b17-9645-21d58e406564 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:27.902968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 31/73] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:27.915629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d646d-37d3-483e-b3c1-d59eac873c67 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:27.959891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a53b-07a5-4b17-9645-21d58e406564 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:27.991694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a6b9c-0701-4f93-a324-5e606282a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:27.992514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a6b9c-0701-4f93-a324-5e606282a0be None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:27.992800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a6b9c-0701-4f93-a324-5e606282a0be None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:27.993082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a6b9c-0701-4f93-a324-5e606282a0be None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:27.998480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d646d-37d3-483e-b3c1-d59eac873c67 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.003258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a6b9c-0701-4f93-a324-5e606282a0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-219a6b9c-0701-4f93-a324-5e606282a0be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:28.011124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:28.011967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:28.012720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 43/74] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:28.013559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8b47b-42d3-4bb3-8441-3ba42b3e26f4 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.013801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8b47b-42d3-4bb3-8441-3ba42b3e26f4 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.014029 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8b47b-42d3-4bb3-8441-3ba42b3e26f4 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.015269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 44/75] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:28.016537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8b47b-42d3-4bb3-8441-3ba42b3e26f4 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.038215 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccb230-1a24-4705-9851-53409a04d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.038886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb230-1a24-4705-9851-53409a04d020 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.039168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb230-1a24-4705-9851-53409a04d020 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.039443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb230-1a24-4705-9851-53409a04d020 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.040315 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccb230-1a24-4705-9851-53409a04d020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:28.040552 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccb230-1a24-4705-9851-53409a04d020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.041938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccb230-1a24-4705-9851-53409a04d020 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.050560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 32/76] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:28.051359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccb230-1a24-4705-9851-53409a04d020 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.070182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.070752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.123341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8b47b-42d3-4bb3-8441-3ba42b3e26f4 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.153793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccb230-1a24-4705-9851-53409a04d020 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.157170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e48a2-220b-4ad5-8b4b-720cb4f485b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.157814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e48a2-220b-4ad5-8b4b-720cb4f485b8 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.158097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e48a2-220b-4ad5-8b4b-720cb4f485b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.158375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e48a2-220b-4ad5-8b4b-720cb4f485b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.187902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8daa51-5844-4d32-8423-a8f702dcf814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.188716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8daa51-5844-4d32-8423-a8f702dcf814 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.189005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8daa51-5844-4d32-8423-a8f702dcf814 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.189282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8daa51-5844-4d32-8423-a8f702dcf814 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.199157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8daa51-5844-4d32-8423-a8f702dcf814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-8e8daa51-5844-4d32-8423-a8f702dcf814 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:28.207236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:28.208284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 33/77] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:28.209211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8daa51-5844-4d32-8423-a8f702dcf814 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.225594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e48a2-220b-4ad5-8b4b-720cb4f485b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.227085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e48a2-220b-4ad5-8b4b-720cb4f485b8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.271514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.285863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.310048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8daa51-5844-4d32-8423-a8f702dcf814 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.324172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 45/78] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:28.325604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32df96-7d10-4ae1-b5da-2efe38a3ac80 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.325901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32df96-7d10-4ae1-b5da-2efe38a3ac80 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.326189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32df96-7d10-4ae1-b5da-2efe38a3ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.342935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-9d32df96-7d10-4ae1-b5da-2efe38a3ac80 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:28.344183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9d32df96-7d10-4ae1-b5da-2efe38a3ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:28.345847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b1913-752d-4520-895b-3552052558fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.346671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b1913-752d-4520-895b-3552052558fe None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.347657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b1913-752d-4520-895b-3552052558fe None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.347972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b1913-752d-4520-895b-3552052558fe None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.348716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b1913-752d-4520-895b-3552052558fe None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:28.349026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b1913-752d-4520-895b-3552052558fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.350412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b1913-752d-4520-895b-3552052558fe None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.358371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 34/79] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:28.359674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b1913-752d-4520-895b-3552052558fe None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.413882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 46/80] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:28.414713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32df96-7d10-4ae1-b5da-2efe38a3ac80 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.461844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b1913-752d-4520-895b-3552052558fe None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.488177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.494642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3eca1-4608-4f7f-9654-31a5ad54bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.495509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3eca1-4608-4f7f-9654-31a5ad54bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.495833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3eca1-4608-4f7f-9654-31a5ad54bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.496111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3eca1-4608-4f7f-9654-31a5ad54bdf7 None admin] PATH_INFO: `/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.497294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3eca1-4608-4f7f-9654-31a5ad54bdf7 None admin] RBAC: Authorizing `identity:get_user(user_id=b772abf551ba4a3bbcb1567e3ad5b88c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.498722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3eca1-4608-4f7f-9654-31a5ad54bdf7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.500383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 35/81] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:28.501197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3eca1-4608-4f7f-9654-31a5ad54bdf7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.505895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.510210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32df96-7d10-4ae1-b5da-2efe38a3ac80 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.543949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe862cf-c569-4664-8ecf-e8b889799995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.544612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe862cf-c569-4664-8ecf-e8b889799995 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.544896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe862cf-c569-4664-8ecf-e8b889799995 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.545171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe862cf-c569-4664-8ecf-e8b889799995 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.546047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe862cf-c569-4664-8ecf-e8b889799995 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:28.546353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe862cf-c569-4664-8ecf-e8b889799995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.548360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe862cf-c569-4664-8ecf-e8b889799995 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.556050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 47/82] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:28.556824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe862cf-c569-4664-8ecf-e8b889799995 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.603901 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3eca1-4608-4f7f-9654-31a5ad54bdf7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.638063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f7ca7-73f2-4f10-9c57-c98f77d0562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.638917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f7ca7-73f2-4f10-9c57-c98f77d0562f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.639205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f7ca7-73f2-4f10-9c57-c98f77d0562f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.639485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f7ca7-73f2-4f10-9c57-c98f77d0562f None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.640711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f7ca7-73f2-4f10-9c57-c98f77d0562f None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.642145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f7ca7-73f2-4f10-9c57-c98f77d0562f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.643849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 36/83] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:28.644598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f7ca7-73f2-4f10-9c57-c98f77d0562f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.652786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe862cf-c569-4664-8ecf-e8b889799995 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.686399 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279e58e-bb6e-4021-a251-bf755d3be8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.687202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279e58e-bb6e-4021-a251-bf755d3be8c3 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.687475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279e58e-bb6e-4021-a251-bf755d3be8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.687789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279e58e-bb6e-4021-a251-bf755d3be8c3 None admin] PATH_INFO: `/v3/users/eaba8e0151814990a7ea9b84d6461ffd` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.688986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279e58e-bb6e-4021-a251-bf755d3be8c3 None admin] RBAC: Authorizing `identity:get_user(user_id=eaba8e0151814990a7ea9b84d6461ffd)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.690465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279e58e-bb6e-4021-a251-bf755d3be8c3 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.692122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 48/84] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/users/eaba8e0151814990a7ea9b84d6461ffd => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:28.692887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279e58e-bb6e-4021-a251-bf755d3be8c3 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.702739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.714199 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.745958 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f7ca7-73f2-4f10-9c57-c98f77d0562f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.778792 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f570-a1b8-4292-a2f0-bf6276a45877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.779581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f570-a1b8-4292-a2f0-bf6276a45877 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.779900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f570-a1b8-4292-a2f0-bf6276a45877 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.780175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f570-a1b8-4292-a2f0-bf6276a45877 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.781827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9f570-a1b8-4292-a2f0-bf6276a45877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.783271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9f570-a1b8-4292-a2f0-bf6276a45877 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.784912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 37/85] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:28.785667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f570-a1b8-4292-a2f0-bf6276a45877 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.795866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279e58e-bb6e-4021-a251-bf755d3be8c3 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.829291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635e551-a2fd-4e87-bf5e-3b878092200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.829935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635e551-a2fd-4e87-bf5e-3b878092200d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.830218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635e551-a2fd-4e87-bf5e-3b878092200d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.830493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635e551-a2fd-4e87-bf5e-3b878092200d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.882895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f570-a1b8-4292-a2f0-bf6276a45877 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.896458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635e551-a2fd-4e87-bf5e-3b878092200d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.897954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635e551-a2fd-4e87-bf5e-3b878092200d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.905266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.915406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44c3a8-2637-4384-8064-391e26e474ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.919251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c3a8-2637-4384-8064-391e26e474ff None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.919251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c3a8-2637-4384-8064-391e26e474ff None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.919251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c3a8-2637-4384-8064-391e26e474ff None admin] PATH_INFO: `/v3/users/eaba8e0151814990a7ea9b84d6461ffd` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.919251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44c3a8-2637-4384-8064-391e26e474ff None admin] RBAC: Authorizing `identity:get_user(user_id=eaba8e0151814990a7ea9b84d6461ffd)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.919551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44c3a8-2637-4384-8064-391e26e474ff None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.921021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 38/86] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/users/eaba8e0151814990a7ea9b84d6461ffd => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:28.921800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44c3a8-2637-4384-8064-391e26e474ff None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.932242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.995273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 49/87] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:28.996134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635e551-a2fd-4e87-bf5e-3b878092200d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.019373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44c3a8-2637-4384-8064-391e26e474ff None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.055095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b0152-e72b-4752-b7bb-e4134f8904ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.055775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b0152-e72b-4752-b7bb-e4134f8904ac None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.056067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b0152-e72b-4752-b7bb-e4134f8904ac None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.056349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b0152-e72b-4752-b7bb-e4134f8904ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.057170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b0152-e72b-4752-b7bb-e4134f8904ac None admin] RBAC: Adding query filter params (role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945, user.id=eaba8e0151814990a7ea9b84d6461ffd) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:29.057485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b0152-e72b-4752-b7bb-e4134f8904ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.058968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b0152-e72b-4752-b7bb-e4134f8904ac None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.066398 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 39/88] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/role_assignments?user.id=eaba8e0151814990a7ea9b84d6461ffd&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:29.067287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b0152-e72b-4752-b7bb-e4134f8904ac None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.100291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635e551-a2fd-4e87-bf5e-3b878092200d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.109339 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.138876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222289ce-7af9-42d7-911d-dace2441283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.139547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222289ce-7af9-42d7-911d-dace2441283a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.139870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222289ce-7af9-42d7-911d-dace2441283a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.140155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222289ce-7af9-42d7-911d-dace2441283a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.150980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.185963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b0152-e72b-4752-b7bb-e4134f8904ac None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.216056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222289ce-7af9-42d7-911d-dace2441283a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.217589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222289ce-7af9-42d7-911d-dace2441283a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.225740 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4182c-a1d7-4c4d-8e21-ea8080bf0472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.226616 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4182c-a1d7-4c4d-8e21-ea8080bf0472 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.227180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4182c-a1d7-4c4d-8e21-ea8080bf0472 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.227461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4182c-a1d7-4c4d-8e21-ea8080bf0472 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.228228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4182c-a1d7-4c4d-8e21-ea8080bf0472 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.230206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4182c-a1d7-4c4d-8e21-ea8080bf0472 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.328488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 40/89] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:19:29 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:29.328488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4182c-a1d7-4c4d-8e21-ea8080bf0472 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.328791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 50/90] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:29.328791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222289ce-7af9-42d7-911d-dace2441283a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.342110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.446965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222289ce-7af9-42d7-911d-dace2441283a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.456715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4182c-a1d7-4c4d-8e21-ea8080bf0472 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.485720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689359c-5c2b-4444-8941-f83a149e2e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.486599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689359c-5c2b-4444-8941-f83a149e2e46 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.486888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689359c-5c2b-4444-8941-f83a149e2e46 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.487169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689359c-5c2b-4444-8941-f83a149e2e46 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.488416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689359c-5c2b-4444-8941-f83a149e2e46 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.489901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689359c-5c2b-4444-8941-f83a149e2e46 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.491655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 51/91] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:29 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:29.492474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689359c-5c2b-4444-8941-f83a149e2e46 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.494681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.512982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad24be-7548-43e7-98b2-518c2a7dfe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.518819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad24be-7548-43e7-98b2-518c2a7dfe24 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.518819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad24be-7548-43e7-98b2-518c2a7dfe24 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.518819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad24be-7548-43e7-98b2-518c2a7dfe24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.597127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.607272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad24be-7548-43e7-98b2-518c2a7dfe24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.608829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad24be-7548-43e7-98b2-518c2a7dfe24 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.630165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689359c-5c2b-4444-8941-f83a149e2e46 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.674286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce848-68a5-4756-9285-d5f510e02883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.675153 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce848-68a5-4756-9285-d5f510e02883 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.675439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce848-68a5-4756-9285-d5f510e02883 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.675713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce848-68a5-4756-9285-d5f510e02883 None admin] PATH_INFO: `/v3/projects/3f8cab87614741a78e7f3aa21d39a43b` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.676936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bce848-68a5-4756-9285-d5f510e02883 None admin] RBAC: Authorizing `identity:get_project(project_id=3f8cab87614741a78e7f3aa21d39a43b)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.678389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bce848-68a5-4756-9285-d5f510e02883 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.680143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 52/92] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:29 2022] GET /identity/v3/projects/3f8cab87614741a78e7f3aa21d39a43b => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:29.680979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce848-68a5-4756-9285-d5f510e02883 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.734900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 41/93] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:29.735803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad24be-7548-43e7-98b2-518c2a7dfe24 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.768110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.807993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce848-68a5-4756-9285-d5f510e02883 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.846850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4d655-5ca3-4c27-9103-360489474e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.848058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4d655-5ca3-4c27-9103-360489474e75 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.848696 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4d655-5ca3-4c27-9103-360489474e75 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.849240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4d655-5ca3-4c27-9103-360489474e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.850365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4d655-5ca3-4c27-9103-360489474e75 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945, user.id=b772abf551ba4a3bbcb1567e3ad5b88c) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:29.850980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4d655-5ca3-4c27-9103-360489474e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.852927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4d655-5ca3-4c27-9103-360489474e75 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.857523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad24be-7548-43e7-98b2-518c2a7dfe24 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.861173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 53/94] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:29 2022] GET /identity/v3/role_assignments?user.id=b772abf551ba4a3bbcb1567e3ad5b88c&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=635caa85d8524fb887206fd521defd3f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:29.862227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4d655-5ca3-4c27-9103-360489474e75 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.872690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.897420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b07bd-20dd-4292-ae72-2d1488066edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.898071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b07bd-20dd-4292-ae72-2d1488066edf None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.898362 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b07bd-20dd-4292-ae72-2d1488066edf None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.898644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b07bd-20dd-4292-ae72-2d1488066edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.899524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b07bd-20dd-4292-ae72-2d1488066edf None admin] RBAC: Adding query filter params (role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=3f8cab87614741a78e7f3aa21d39a43b, user.id=eaba8e0151814990a7ea9b84d6461ffd) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:29.899869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b07bd-20dd-4292-ae72-2d1488066edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.902270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b07bd-20dd-4292-ae72-2d1488066edf None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.909603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 42/95] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:29 2022] GET /identity/v3/role_assignments?user.id=eaba8e0151814990a7ea9b84d6461ffd&scope.project.id=3f8cab87614741a78e7f3aa21d39a43b&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:29.984737 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4d655-5ca3-4c27-9103-360489474e75 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:30.024500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b20638-6d7b-41d7-8f4e-41a3c61197ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:30.025761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20638-6d7b-41d7-8f4e-41a3c61197ef None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:30.026272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20638-6d7b-41d7-8f4e-41a3c61197ef None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:30.026762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20638-6d7b-41d7-8f4e-41a3c61197ef None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:30.028248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b20638-6d7b-41d7-8f4e-41a3c61197ef None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:30.029937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b20638-6d7b-41d7-8f4e-41a3c61197ef None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:30.032992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 54/96] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:29 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:30.040878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b07bd-20dd-4292-ae72-2d1488066edf None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:30.169069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:30.178516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b07bd-20dd-4292-ae72-2d1488066edf None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:30.215012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0c32f-36be-4748-9810-5b94ef139212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:30.215755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0c32f-36be-4748-9810-5b94ef139212 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:30.216054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0c32f-36be-4748-9810-5b94ef139212 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:30.216333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0c32f-36be-4748-9810-5b94ef139212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:30.217178 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0c32f-36be-4748-9810-5b94ef139212 None admin] RBAC: Adding query filter params (role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945, user.id=eaba8e0151814990a7ea9b84d6461ffd) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:30.217490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0c32f-36be-4748-9810-5b94ef139212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:30.219489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0c32f-36be-4748-9810-5b94ef139212 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:30.225846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 43/97] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:30 2022] GET /identity/v3/role_assignments?user.id=eaba8e0151814990a7ea9b84d6461ffd&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:31.674196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27845257-7c12-4fee-9044-8f0431a21135 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:31.675196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27845257-7c12-4fee-9044-8f0431a21135 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:31.675692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27845257-7c12-4fee-9044-8f0431a21135 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:31.677688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 55/98] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:31.682941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd3608-6b50-4a62-a2b5-a7f85bb93fc0 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:31.683891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd3608-6b50-4a62-a2b5-a7f85bb93fc0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:31.684396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd3608-6b50-4a62-a2b5-a7f85bb93fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:31.708459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-31bd3608-6b50-4a62-a2b5-a7f85bb93fc0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:31.710119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-31bd3608-6b50-4a62-a2b5-a7f85bb93fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:31.806313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 44/99] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:31.848519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27845257-7c12-4fee-9044-8f0431a21135 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:31.937771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:31.968924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27845257-7c12-4fee-9044-8f0431a21135 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:32.012221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95bf8a-cd8a-480b-ae6b-dc6ac1b96f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:32.013395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bf8a-cd8a-480b-ae6b-dc6ac1b96f13 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.013880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bf8a-cd8a-480b-ae6b-dc6ac1b96f13 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.014363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bf8a-cd8a-480b-ae6b-dc6ac1b96f13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.032571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95bf8a-cd8a-480b-ae6b-dc6ac1b96f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-df95bf8a-cd8a-480b-ae6b-dc6ac1b96f13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:32.040751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:32.041581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:32.042319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 56/100] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:32.049234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd3608-6b50-4a62-a2b5-a7f85bb93fc0 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:32.162613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:32.178058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd3608-6b50-4a62-a2b5-a7f85bb93fc0 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:32.205270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4cbed-0c5b-405a-b014-dc02db7a477f None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.205536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4cbed-0c5b-405a-b014-dc02db7a477f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.205776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4cbed-0c5b-405a-b014-dc02db7a477f None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.207438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 57/101] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:32.213002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f7d5-a286-4a72-bca6-fdd53a8e8c56 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.213325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f7d5-a286-4a72-bca6-fdd53a8e8c56 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.213566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f7d5-a286-4a72-bca6-fdd53a8e8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.218982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49d17f-02eb-4c8a-8015-6816b71bab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:32.219650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49d17f-02eb-4c8a-8015-6816b71bab80 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.219958 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49d17f-02eb-4c8a-8015-6816b71bab80 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.220237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49d17f-02eb-4c8a-8015-6816b71bab80 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.220980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49d17f-02eb-4c8a-8015-6816b71bab80 None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:32.221289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49d17f-02eb-4c8a-8015-6816b71bab80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:32.222672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49d17f-02eb-4c8a-8015-6816b71bab80 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:32.243821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 45/102] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:32.245266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49d17f-02eb-4c8a-8015-6816b71bab80 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:32.251770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-abe2f7d5-a286-4a72-bca6-fdd53a8e8c56 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:32.251770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-abe2f7d5-a286-4a72-bca6-fdd53a8e8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:32.372720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49d17f-02eb-4c8a-8015-6816b71bab80 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:32.383786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 58/103] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:32.409899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546a6f3-f02e-4dc5-89c4-5861267b7625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:32.410832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546a6f3-f02e-4dc5-89c4-5861267b7625 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.411253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546a6f3-f02e-4dc5-89c4-5861267b7625 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.411640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546a6f3-f02e-4dc5-89c4-5861267b7625 None admin] PATH_INFO: `/v3/users/eaba8e0151814990a7ea9b84d6461ffd` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.413375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546a6f3-f02e-4dc5-89c4-5861267b7625 None admin] RBAC: Authorizing `identity:get_user(user_id=eaba8e0151814990a7ea9b84d6461ffd)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:32.415561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546a6f3-f02e-4dc5-89c4-5861267b7625 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:32.418048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 46/104] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:32 2022] GET /identity/v3/users/eaba8e0151814990a7ea9b84d6461ffd => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:32.423340 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2f7d5-a286-4a72-bca6-fdd53a8e8c56 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:32.433338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546a6f3-f02e-4dc5-89c4-5861267b7625 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:32.470826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:32.595940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546a6f3-f02e-4dc5-89c4-5861267b7625 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:32.632112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:32.661004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee906f1-56fe-4f39-a2fd-da748151b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:32.661814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee906f1-56fe-4f39-a2fd-da748151b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.662104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee906f1-56fe-4f39-a2fd-da748151b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.662389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee906f1-56fe-4f39-a2fd-da748151b0e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.668459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee906f1-56fe-4f39-a2fd-da748151b0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:32.669928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee906f1-56fe-4f39-a2fd-da748151b0e7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:32.672156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 47/105] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:32.681320 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee906f1-56fe-4f39-a2fd-da748151b0e7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:32.702852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2f7d5-a286-4a72-bca6-fdd53a8e8c56 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:32.769748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0a9e-9cc9-454c-963f-ab5af3113598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:32.770544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0a9e-9cc9-454c-963f-ab5af3113598 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.770831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0a9e-9cc9-454c-963f-ab5af3113598 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.771109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b0a9e-9cc9-454c-963f-ab5af3113598 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.772513 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b0a9e-9cc9-454c-963f-ab5af3113598 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:32.773973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b0a9e-9cc9-454c-963f-ab5af3113598 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:32.775676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 59/106] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:32 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:32.781973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0a9e-9cc9-454c-963f-ab5af3113598 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:32.821107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:32.839236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee906f1-56fe-4f39-a2fd-da748151b0e7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:32.879197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc005c1c-ade4-4a20-8d95-e9d85e45693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:32.880330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc005c1c-ade4-4a20-8d95-e9d85e45693d None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.880620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc005c1c-ade4-4a20-8d95-e9d85e45693d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.880900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc005c1c-ade4-4a20-8d95-e9d85e45693d None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.881889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc005c1c-ade4-4a20-8d95-e9d85e45693d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:32.883345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc005c1c-ade4-4a20-8d95-e9d85e45693d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:32.943985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b0a9e-9cc9-454c-963f-ab5af3113598 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:32.966865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 48/107] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:19:32 2022] POST /identity/v3/projects => generated 302 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:19:32.986781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:32.990278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a230331-c6b7-482e-a96a-f091a4c99ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:32.991244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230331-c6b7-482e-a96a-f091a4c99ffd None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.991531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230331-c6b7-482e-a96a-f091a4c99ffd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.991840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230331-c6b7-482e-a96a-f091a4c99ffd None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/users/eaba8e0151814990a7ea9b84d6461ffd/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.994069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a230331-c6b7-482e-a96a-f091a4c99ffd None admin] RBAC: Authorizing `identity:create_grant(project_id=6999191d4ebb497fbaa576c8e3c1b945, user_id=eaba8e0151814990a7ea9b84d6461ffd, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:32.995641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a230331-c6b7-482e-a96a-f091a4c99ffd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:33.075940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 60/108] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:19:32 2022] PUT /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/users/eaba8e0151814990a7ea9b84d6461ffd/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:19:33.106693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dffee7-6f59-4dc8-bb79-e64d7e105f9f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.107030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dffee7-6f59-4dc8-bb79-e64d7e105f9f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.107263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dffee7-6f59-4dc8-bb79-e64d7e105f9f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.108789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 49/109] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:33.115488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869acbc0-3a28-4364-8e63-250db8878b0c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.115848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869acbc0-3a28-4364-8e63-250db8878b0c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.116135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869acbc0-3a28-4364-8e63-250db8878b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.140911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-869acbc0-3a28-4364-8e63-250db8878b0c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:33.142469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-869acbc0-3a28-4364-8e63-250db8878b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:33.162304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab5de-32ff-4784-94c1-e1a3f1813ee5 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.162607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab5de-32ff-4784-94c1-e1a3f1813ee5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.162869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab5de-32ff-4784-94c1-e1a3f1813ee5 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.164551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 50/110] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:33.172059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08644de7-035b-4280-935f-dc5b30bf642b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.172361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08644de7-035b-4280-935f-dc5b30bf642b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.172633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08644de7-035b-4280-935f-dc5b30bf642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.201474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-08644de7-035b-4280-935f-dc5b30bf642b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:33.202752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-08644de7-035b-4280-935f-dc5b30bf642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:33.275029 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 61/111] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:33.299890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869acbc0-3a28-4364-8e63-250db8878b0c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:33.316212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 51/112] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:33.345070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08644de7-035b-4280-935f-dc5b30bf642b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:33.413027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869acbc0-3a28-4364-8e63-250db8878b0c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:33.416489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:33.437701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:33.452413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac720-509a-4157-90b1-14a6b6b6a477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:33.453993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac720-509a-4157-90b1-14a6b6b6a477 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.454278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac720-509a-4157-90b1-14a6b6b6a477 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.454553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac720-509a-4157-90b1-14a6b6b6a477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.455129 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08644de7-035b-4280-935f-dc5b30bf642b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:33.468041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac720-509a-4157-90b1-14a6b6b6a477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-a2dac720-509a-4157-90b1-14a6b6b6a477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:33.478081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:33.478992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:33.480197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:33.481312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 62/113] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:19:33.482946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd6011-df84-4939-bc35-9a89cc0d79d7 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.483125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd6011-df84-4939-bc35-9a89cc0d79d7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.483276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd6011-df84-4939-bc35-9a89cc0d79d7 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.484894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 63/114] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:33.487542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd6011-df84-4939-bc35-9a89cc0d79d7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:33.501025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e70a87-47f2-45ee-8ca9-d01899aca769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:33.501967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e70a87-47f2-45ee-8ca9-d01899aca769 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.502312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e70a87-47f2-45ee-8ca9-d01899aca769 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.502658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e70a87-47f2-45ee-8ca9-d01899aca769 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.515022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e70a87-47f2-45ee-8ca9-d01899aca769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-77e70a87-47f2-45ee-8ca9-d01899aca769 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:33.523429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:33.525849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 52/115] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:19:33.527943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac805a73-03e6-4bcf-b7b6-558756736941 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.529767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac805a73-03e6-4bcf-b7b6-558756736941 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.529767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac805a73-03e6-4bcf-b7b6-558756736941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.546876 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ac805a73-03e6-4bcf-b7b6-558756736941 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:33.548136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ac805a73-03e6-4bcf-b7b6-558756736941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:33.624653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 53/116] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:33.625617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac805a73-03e6-4bcf-b7b6-558756736941 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:33.625772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd6011-df84-4939-bc35-9a89cc0d79d7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:33.669196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa92207-e85a-46b2-b555-7790fd76084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:33.669877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa92207-e85a-46b2-b555-7790fd76084a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.670164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa92207-e85a-46b2-b555-7790fd76084a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.670442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa92207-e85a-46b2-b555-7790fd76084a None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.671191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa92207-e85a-46b2-b555-7790fd76084a None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:33.671535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa92207-e85a-46b2-b555-7790fd76084a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:33.673605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa92207-e85a-46b2-b555-7790fd76084a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:33.682882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 64/117] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:33.684537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa92207-e85a-46b2-b555-7790fd76084a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:33.737068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:33.738341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:33.801697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa92207-e85a-46b2-b555-7790fd76084a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:33.841313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a74d2d-446c-46f7-b638-cc306fcff96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:33.842256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a74d2d-446c-46f7-b638-cc306fcff96d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.842541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a74d2d-446c-46f7-b638-cc306fcff96d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.842821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a74d2d-446c-46f7-b638-cc306fcff96d None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.853876 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac805a73-03e6-4bcf-b7b6-558756736941 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:33.857707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a74d2d-446c-46f7-b638-cc306fcff96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-10a74d2d-446c-46f7-b638-cc306fcff96d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:33.866389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:33.868433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 65/118] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:33.870346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a74d2d-446c-46f7-b638-cc306fcff96d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:33.956578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ad11a-32ac-4520-a09b-73936c277029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:33.957185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ad11a-32ac-4520-a09b-73936c277029 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:33.957474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ad11a-32ac-4520-a09b-73936c277029 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:33.957757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ad11a-32ac-4520-a09b-73936c277029 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:33.958529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ad11a-32ac-4520-a09b-73936c277029 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:33.958842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ad11a-32ac-4520-a09b-73936c277029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:33.960269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ad11a-32ac-4520-a09b-73936c277029 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:33.975283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 54/119] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:33.976168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ad11a-32ac-4520-a09b-73936c277029 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:33.995048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a74d2d-446c-46f7-b638-cc306fcff96d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:33.998238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:34.033114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b74891-aa3a-4a24-a8ac-a2c901a2cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:34.034734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b74891-aa3a-4a24-a8ac-a2c901a2cee1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.037175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b74891-aa3a-4a24-a8ac-a2c901a2cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.037175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b74891-aa3a-4a24-a8ac-a2c901a2cee1 None admin] PATH_INFO: `/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.046016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b74891-aa3a-4a24-a8ac-a2c901a2cee1 None admin] RBAC: Authorizing `identity:get_user(user_id=b772abf551ba4a3bbcb1567e3ad5b88c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:34.048299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b74891-aa3a-4a24-a8ac-a2c901a2cee1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:34.050392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 66/120] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:33 2022] GET /identity/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:34.054060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1c4e5-82b5-41b1-9895-2f24a6e7c9a6 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.054060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1c4e5-82b5-41b1-9895-2f24a6e7c9a6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.054060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1c4e5-82b5-41b1-9895-2f24a6e7c9a6 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.054060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 67/121] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:34.054630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1c4e5-82b5-41b1-9895-2f24a6e7c9a6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:34.108224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ad11a-32ac-4520-a09b-73936c277029 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:34.132259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:34.155021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1f2da-e700-433d-a14c-434d56364bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:34.156086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1f2da-e700-433d-a14c-434d56364bdf None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.156585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1f2da-e700-433d-a14c-434d56364bdf None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.157053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1f2da-e700-433d-a14c-434d56364bdf None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.158499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1f2da-e700-433d-a14c-434d56364bdf None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:34.159007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1f2da-e700-433d-a14c-434d56364bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:34.161460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1f2da-e700-433d-a14c-434d56364bdf None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:34.176109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 55/122] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:34.180894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1f2da-e700-433d-a14c-434d56364bdf None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:34.196869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1c4e5-82b5-41b1-9895-2f24a6e7c9a6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:34.244352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d516ef6-2b8d-4229-b857-745b00d9ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:34.245556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516ef6-2b8d-4229-b857-745b00d9ec83 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.246243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516ef6-2b8d-4229-b857-745b00d9ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.247053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516ef6-2b8d-4229-b857-745b00d9ec83 None admin] PATH_INFO: `/v3/users/0f273fb15f6c459194f34ae4de77eab3` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.265839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d516ef6-2b8d-4229-b857-745b00d9ec83 None admin] RBAC: Authorizing `identity:get_user(user_id=0f273fb15f6c459194f34ae4de77eab3)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:34.267882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d516ef6-2b8d-4229-b857-745b00d9ec83 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:34.270732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 68/123] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:34 2022] GET /identity/v3/users/0f273fb15f6c459194f34ae4de77eab3 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:34.272485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ddb5-08ea-4aae-89f5-97aad0d38157 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.272915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ddb5-08ea-4aae-89f5-97aad0d38157 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.273327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ddb5-08ea-4aae-89f5-97aad0d38157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.287807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1f2da-e700-433d-a14c-434d56364bdf None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:34.295059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e9d0ddb5-08ea-4aae-89f5-97aad0d38157 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:34.297505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e9d0ddb5-08ea-4aae-89f5-97aad0d38157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:34.324511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8cb52-db6d-4942-a31d-42bc757d5a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:34.325849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8cb52-db6d-4942-a31d-42bc757d5a4b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.325849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8cb52-db6d-4942-a31d-42bc757d5a4b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.326246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8cb52-db6d-4942-a31d-42bc757d5a4b None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.327555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8cb52-db6d-4942-a31d-42bc757d5a4b None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:34.329391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8cb52-db6d-4942-a31d-42bc757d5a4b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:34.329867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:34.336190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 56/124] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:34 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:34.337208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8cb52-db6d-4942-a31d-42bc757d5a4b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:34.386562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 69/125] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:34.393722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0ddb5-08ea-4aae-89f5-97aad0d38157 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:34.399384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:34.464095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8cb52-db6d-4942-a31d-42bc757d5a4b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:34.499949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132bd2-075f-465f-978d-d4923adcfff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:34.501185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132bd2-075f-465f-978d-d4923adcfff0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.501687 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132bd2-075f-465f-978d-d4923adcfff0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.502154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132bd2-075f-465f-978d-d4923adcfff0 None admin] PATH_INFO: `/v3/users/eaba8e0151814990a7ea9b84d6461ffd` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.503580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31132bd2-075f-465f-978d-d4923adcfff0 None admin] RBAC: Authorizing `identity:get_user(user_id=eaba8e0151814990a7ea9b84d6461ffd)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:34.505259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31132bd2-075f-465f-978d-d4923adcfff0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:34.511898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 57/126] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:34 2022] GET /identity/v3/users/eaba8e0151814990a7ea9b84d6461ffd => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:34.513029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132bd2-075f-465f-978d-d4923adcfff0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:34.527527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0ddb5-08ea-4aae-89f5-97aad0d38157 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:34.564996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d983ed-e22f-436d-bca9-1604baf7355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:34.566051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d983ed-e22f-436d-bca9-1604baf7355c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.566621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d983ed-e22f-436d-bca9-1604baf7355c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.567109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d983ed-e22f-436d-bca9-1604baf7355c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.598181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:34.641534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d983ed-e22f-436d-bca9-1604baf7355c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:34.642897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132bd2-075f-465f-978d-d4923adcfff0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:34.643630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d983ed-e22f-436d-bca9-1604baf7355c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:34.663589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:34.691442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fee46-23fe-46c9-812a-800b157264bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:34.692466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fee46-23fe-46c9-812a-800b157264bb None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.692822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fee46-23fe-46c9-812a-800b157264bb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.693654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fee46-23fe-46c9-812a-800b157264bb None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/users/b772abf551ba4a3bbcb1567e3ad5b88c/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.696771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fee46-23fe-46c9-812a-800b157264bb None admin] RBAC: Authorizing `identity:create_grant(project_id=6999191d4ebb497fbaa576c8e3c1b945, user_id=b772abf551ba4a3bbcb1567e3ad5b88c, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:34.698941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fee46-23fe-46c9-812a-800b157264bb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:34.757525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 70/127] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:34.758900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d983ed-e22f-436d-bca9-1604baf7355c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:34.807608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 58/128] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:19:34 2022] PUT /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/users/b772abf551ba4a3bbcb1567e3ad5b88c/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:19:34.808937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fee46-23fe-46c9-812a-800b157264bb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:34.829438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:34.883178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d983ed-e22f-436d-bca9-1604baf7355c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:34.928127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870f050-aafe-472d-80bd-892f085d110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:34.929375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f050-aafe-472d-80bd-892f085d110c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:34.929757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f050-aafe-472d-80bd-892f085d110c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:34.930369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f050-aafe-472d-80bd-892f085d110c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:34.946486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870f050-aafe-472d-80bd-892f085d110c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:34.953743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fee46-23fe-46c9-812a-800b157264bb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-0870f050-aafe-472d-80bd-892f085d110c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:34.958184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:34.959084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:34.959888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 71/129] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:19:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:34.960505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870f050-aafe-472d-80bd-892f085d110c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:35.015627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582ea67-ebe0-4319-9d31-420456d08659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:35.017714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582ea67-ebe0-4319-9d31-420456d08659 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.017999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582ea67-ebe0-4319-9d31-420456d08659 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.018275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582ea67-ebe0-4319-9d31-420456d08659 None admin] PATH_INFO: `/v3/projects/3f8cab87614741a78e7f3aa21d39a43b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.021059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582ea67-ebe0-4319-9d31-420456d08659 None admin] RBAC: Authorizing `identity:get_project(project_id=3f8cab87614741a78e7f3aa21d39a43b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:35.022760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582ea67-ebe0-4319-9d31-420456d08659 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:35.026219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 59/130] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:34 2022] GET /identity/v3/projects/3f8cab87614741a78e7f3aa21d39a43b => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:35.026696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582ea67-ebe0-4319-9d31-420456d08659 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:35.107012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:35.140160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870f050-aafe-472d-80bd-892f085d110c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:35.163413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:35.179113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ad492-28cf-444e-82bb-06320d16d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:35.180387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ad492-28cf-444e-82bb-06320d16d8fb None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.180563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582ea67-ebe0-4319-9d31-420456d08659 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:35.181059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ad492-28cf-444e-82bb-06320d16d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.181566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ad492-28cf-444e-82bb-06320d16d8fb None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.183081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ad492-28cf-444e-82bb-06320d16d8fb None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:35.184792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ad492-28cf-444e-82bb-06320d16d8fb None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:35.186738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 72/131] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:34 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:35.187813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ad492-28cf-444e-82bb-06320d16d8fb None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:35.244494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86f386-aeef-4e7d-84ff-829c708235c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:35.245531 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86f386-aeef-4e7d-84ff-829c708235c7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.246857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86f386-aeef-4e7d-84ff-829c708235c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.247338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86f386-aeef-4e7d-84ff-829c708235c7 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.249733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86f386-aeef-4e7d-84ff-829c708235c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:35.250581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86f386-aeef-4e7d-84ff-829c708235c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:35.252790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86f386-aeef-4e7d-84ff-829c708235c7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:35.269779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 60/132] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:19:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:35.273412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86f386-aeef-4e7d-84ff-829c708235c7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:35.363152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ad492-28cf-444e-82bb-06320d16d8fb None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:35.402404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb264ca-d093-43f6-a265-a16b69252aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:35.403844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb264ca-d093-43f6-a265-a16b69252aec None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.404626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb264ca-d093-43f6-a265-a16b69252aec None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.405112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb264ca-d093-43f6-a265-a16b69252aec None admin] PATH_INFO: `/v3/projects/3f8cab87614741a78e7f3aa21d39a43b/users/eaba8e0151814990a7ea9b84d6461ffd/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.408349 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb264ca-d093-43f6-a265-a16b69252aec None admin] RBAC: Authorizing `identity:create_grant(project_id=3f8cab87614741a78e7f3aa21d39a43b, user_id=eaba8e0151814990a7ea9b84d6461ffd, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:35.410206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb264ca-d093-43f6-a265-a16b69252aec None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:35.429147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86f386-aeef-4e7d-84ff-829c708235c7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:35.463159 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:35.468913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5601bd-62a9-4bb6-9af5-75e330613bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:35.469576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5601bd-62a9-4bb6-9af5-75e330613bfb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.470119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5601bd-62a9-4bb6-9af5-75e330613bfb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.470399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5601bd-62a9-4bb6-9af5-75e330613bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.471439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5601bd-62a9-4bb6-9af5-75e330613bfb None admin] RBAC: Adding query filter params (role.id=e68a59a8cda94903b57e7f58718fd182, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945, user.id=0f273fb15f6c459194f34ae4de77eab3) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:35.471867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5601bd-62a9-4bb6-9af5-75e330613bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:35.473502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5601bd-62a9-4bb6-9af5-75e330613bfb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:35.479649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 61/133] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:35 2022] GET /identity/v3/role_assignments?user.id=0f273fb15f6c459194f34ae4de77eab3&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=e68a59a8cda94903b57e7f58718fd182 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:35.480484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5601bd-62a9-4bb6-9af5-75e330613bfb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:35.492531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 73/134] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:19:35 2022] PUT /identity/v3/projects/3f8cab87614741a78e7f3aa21d39a43b/users/eaba8e0151814990a7ea9b84d6461ffd/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:19:35.643961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5601bd-62a9-4bb6-9af5-75e330613bfb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:35.697641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210bf9c-a1b7-4bc5-be0d-84903cd39abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:35.698581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210bf9c-a1b7-4bc5-be0d-84903cd39abd None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.698865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210bf9c-a1b7-4bc5-be0d-84903cd39abd None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.699151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210bf9c-a1b7-4bc5-be0d-84903cd39abd None admin] PATH_INFO: `/v3/users/eaba8e0151814990a7ea9b84d6461ffd` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.704810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210bf9c-a1b7-4bc5-be0d-84903cd39abd None admin] RBAC: Authorizing `identity:get_user(user_id=eaba8e0151814990a7ea9b84d6461ffd)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:35.706421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210bf9c-a1b7-4bc5-be0d-84903cd39abd None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:35.708398 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 62/135] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:35 2022] GET /identity/v3/users/eaba8e0151814990a7ea9b84d6461ffd => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:35.714838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb264ca-d093-43f6-a265-a16b69252aec None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:35.761146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3010b-1590-4820-9091-d17ebe5d8185 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.761460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3010b-1590-4820-9091-d17ebe5d8185 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.761714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3010b-1590-4820-9091-d17ebe5d8185 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.763677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 63/136] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:35.771050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91a16-0b46-4d15-a335-63a26cdbcbd8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.771375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91a16-0b46-4d15-a335-63a26cdbcbd8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.771623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91a16-0b46-4d15-a335-63a26cdbcbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.792774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:35.795556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-19e91a16-0b46-4d15-a335-63a26cdbcbd8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:35.796885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-19e91a16-0b46-4d15-a335-63a26cdbcbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:35.833405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:35.867942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb264ca-d093-43f6-a265-a16b69252aec None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:35.883588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 64/137] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:35.885096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efd5c-9251-41d0-99fd-4168bae54dfe None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.885394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efd5c-9251-41d0-99fd-4168bae54dfe None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.885706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efd5c-9251-41d0-99fd-4168bae54dfe None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.887894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 65/138] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:35.893482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71241e-0c9c-4e3e-9ce0-fb344ea1425a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.893777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71241e-0c9c-4e3e-9ce0-fb344ea1425a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.894112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71241e-0c9c-4e3e-9ce0-fb344ea1425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.911222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d997cf5-72ab-46af-a70c-349af0a16b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:35.911410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0a71241e-0c9c-4e3e-9ce0-fb344ea1425a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:35.912130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d997cf5-72ab-46af-a70c-349af0a16b92 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.912416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d997cf5-72ab-46af-a70c-349af0a16b92 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.912591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0a71241e-0c9c-4e3e-9ce0-fb344ea1425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:35.912680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d997cf5-72ab-46af-a70c-349af0a16b92 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.913988 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d997cf5-72ab-46af-a70c-349af0a16b92 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:35.915559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d997cf5-72ab-46af-a70c-349af0a16b92 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:35.917312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 74/139] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:35 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:35.923138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d997cf5-72ab-46af-a70c-349af0a16b92 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:35.982937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 66/140] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:35.983866 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71241e-0c9c-4e3e-9ce0-fb344ea1425a None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:36.030818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d997cf5-72ab-46af-a70c-349af0a16b92 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:36.048002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:36.067913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459129d-b60a-4335-a16d-33d6a28f6f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:36.068810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459129d-b60a-4335-a16d-33d6a28f6f0c None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:36.069092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459129d-b60a-4335-a16d-33d6a28f6f0c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:36.069382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459129d-b60a-4335-a16d-33d6a28f6f0c None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/users/eaba8e0151814990a7ea9b84d6461ffd/roles/19d43474add64d77beb4f1d8b56a2740` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:36.071620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459129d-b60a-4335-a16d-33d6a28f6f0c None admin] RBAC: Authorizing `identity:create_grant(project_id=6999191d4ebb497fbaa576c8e3c1b945, user_id=eaba8e0151814990a7ea9b84d6461ffd, role_id=19d43474add64d77beb4f1d8b56a2740)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:36.073284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459129d-b60a-4335-a16d-33d6a28f6f0c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:36.116960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:36.121171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71241e-0c9c-4e3e-9ce0-fb344ea1425a None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:36.156575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0340b1-f0a5-4742-b1da-80c111c713c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:36.157370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0340b1-f0a5-4742-b1da-80c111c713c4 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:36.157663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0340b1-f0a5-4742-b1da-80c111c713c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:36.157946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0340b1-f0a5-4742-b1da-80c111c713c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:36.168515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0340b1-f0a5-4742-b1da-80c111c713c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-0b0340b1-f0a5-4742-b1da-80c111c713c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:36.177249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:36.179067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 67/141] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:36.181211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0340b1-f0a5-4742-b1da-80c111c713c4 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:36.202881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 75/142] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:19:35 2022] PUT /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/users/eaba8e0151814990a7ea9b84d6461ffd/roles/19d43474add64d77beb4f1d8b56a2740 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:19:36.208702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459129d-b60a-4335-a16d-33d6a28f6f0c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:36.352910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0340b1-f0a5-4742-b1da-80c111c713c4 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:36.421070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c560144-9efc-4f8a-95d9-b11e99a6ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:36.421843 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c560144-9efc-4f8a-95d9-b11e99a6ced9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:36.422131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c560144-9efc-4f8a-95d9-b11e99a6ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:36.422413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c560144-9efc-4f8a-95d9-b11e99a6ced9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:36.424342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c560144-9efc-4f8a-95d9-b11e99a6ced9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:36.425841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c560144-9efc-4f8a-95d9-b11e99a6ced9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:36.427548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 68/143] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:36.436817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c560144-9efc-4f8a-95d9-b11e99a6ced9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:36.439794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459129d-b60a-4335-a16d-33d6a28f6f0c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:36.486752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee640-474d-48d9-a87d-7f0996b6e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:36.487444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee640-474d-48d9-a87d-7f0996b6e714 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:36.487806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee640-474d-48d9-a87d-7f0996b6e714 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:36.488096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee640-474d-48d9-a87d-7f0996b6e714 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:36.488847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:36.489738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee640-474d-48d9-a87d-7f0996b6e714 None admin] RBAC: Adding query filter params (name=member) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:36.490068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee640-474d-48d9-a87d-7f0996b6e714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:36.491452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee640-474d-48d9-a87d-7f0996b6e714 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:36.501656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 76/144] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:36.510295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee640-474d-48d9-a87d-7f0996b6e714 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:36.595068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:36.620733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c560144-9efc-4f8a-95d9-b11e99a6ced9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:36.662902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe390576-789f-4891-9ae8-38f490ae80d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:36.663582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe390576-789f-4891-9ae8-38f490ae80d1 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:36.663896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe390576-789f-4891-9ae8-38f490ae80d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:36.664174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe390576-789f-4891-9ae8-38f490ae80d1 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:36.664888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe390576-789f-4891-9ae8-38f490ae80d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:36.666326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe390576-789f-4891-9ae8-38f490ae80d1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:36.711266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee640-474d-48d9-a87d-7f0996b6e714 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:36.758646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217319-47b5-4551-8a17-13eb07a99246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:36.759650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217319-47b5-4551-8a17-13eb07a99246 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:36.760040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217319-47b5-4551-8a17-13eb07a99246 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:36.760324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217319-47b5-4551-8a17-13eb07a99246 None admin] PATH_INFO: `/v3/users/eaba8e0151814990a7ea9b84d6461ffd` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:36.761886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b217319-47b5-4551-8a17-13eb07a99246 None admin] RBAC: Authorizing `identity:get_user(user_id=eaba8e0151814990a7ea9b84d6461ffd)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:36.763361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b217319-47b5-4551-8a17-13eb07a99246 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:36.765817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 77/145] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:36 2022] GET /identity/v3/users/eaba8e0151814990a7ea9b84d6461ffd => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:36.770916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217319-47b5-4551-8a17-13eb07a99246 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:36.796400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 69/146] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:19:36 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:36.919368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217319-47b5-4551-8a17-13eb07a99246 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:36.934339 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:36.972492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98ca80-2455-4f7f-849a-d6210bc5acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:36.973518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98ca80-2455-4f7f-849a-d6210bc5acbd None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:36.974042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98ca80-2455-4f7f-849a-d6210bc5acbd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:36.974533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98ca80-2455-4f7f-849a-d6210bc5acbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:37.061869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98ca80-2455-4f7f-849a-d6210bc5acbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:37.063368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98ca80-2455-4f7f-849a-d6210bc5acbd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:37.172834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 78/147] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:19:37.180875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe390576-789f-4891-9ae8-38f490ae80d1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:37.313508 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:37.336239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe390576-789f-4891-9ae8-38f490ae80d1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:37.381991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483e4d7-8306-4b9e-af37-528de6e5dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:37.382868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e4d7-8306-4b9e-af37-528de6e5dad8 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:37.383149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e4d7-8306-4b9e-af37-528de6e5dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:37.383423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e4d7-8306-4b9e-af37-528de6e5dad8 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:37.388472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483e4d7-8306-4b9e-af37-528de6e5dad8 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:37.390428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483e4d7-8306-4b9e-af37-528de6e5dad8 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:37.392198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 70/148] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:37 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:37.398356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98ca80-2455-4f7f-849a-d6210bc5acbd None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:37.410965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:37.531691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98ca80-2455-4f7f-849a-d6210bc5acbd None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:37.571671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea7621-5c8a-49ed-90ca-e8ee647da98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:37.572376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea7621-5c8a-49ed-90ca-e8ee647da98a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:37.572667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea7621-5c8a-49ed-90ca-e8ee647da98a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:37.572949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea7621-5c8a-49ed-90ca-e8ee647da98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:37.573796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea7621-5c8a-49ed-90ca-e8ee647da98a None admin] RBAC: Adding query filter params (role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945, user.id=eaba8e0151814990a7ea9b84d6461ffd) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:37.574119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea7621-5c8a-49ed-90ca-e8ee647da98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:37.575603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea7621-5c8a-49ed-90ca-e8ee647da98a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:37.582371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 79/149] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:37 2022] GET /identity/v3/role_assignments?user.id=eaba8e0151814990a7ea9b84d6461ffd&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:38.302717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a152199-7f61-4738-a28a-792a978162fb None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.303201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a152199-7f61-4738-a28a-792a978162fb None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.303201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a152199-7f61-4738-a28a-792a978162fb None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.304718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 71/150] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:38.319913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc783a7-289c-4394-8c90-c14f4645da0c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.319913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc783a7-289c-4394-8c90-c14f4645da0c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.319913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc783a7-289c-4394-8c90-c14f4645da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.340272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-edc783a7-289c-4394-8c90-c14f4645da0c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:38.341768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-edc783a7-289c-4394-8c90-c14f4645da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:38.429689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:38.434088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 80/151] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:38.471307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a152199-7f61-4738-a28a-792a978162fb None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:38.597270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a152199-7f61-4738-a28a-792a978162fb None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:38.642703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fef3a-8058-4e7e-a5ef-913a5df18307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:38.643554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fef3a-8058-4e7e-a5ef-913a5df18307 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.643837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fef3a-8058-4e7e-a5ef-913a5df18307 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.644122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fef3a-8058-4e7e-a5ef-913a5df18307 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.664721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fef3a-8058-4e7e-a5ef-913a5df18307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-604fef3a-8058-4e7e-a5ef-913a5df18307 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:38.672715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:38.673682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:38.674472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 72/152] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:38.679922 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc783a7-289c-4394-8c90-c14f4645da0c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:38.839363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc783a7-289c-4394-8c90-c14f4645da0c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:38.839994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973a71f-e51f-4eef-8179-820872769f8a None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.840291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973a71f-e51f-4eef-8179-820872769f8a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.840576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973a71f-e51f-4eef-8179-820872769f8a None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.841956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 73/153] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:38.851416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb2c6-e038-43b0-b2df-5cefa24b8534 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.851674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb2c6-e038-43b0-b2df-5cefa24b8534 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.851946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb2c6-e038-43b0-b2df-5cefa24b8534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.886599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-e6dfb2c6-e038-43b0-b2df-5cefa24b8534 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:38.888139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e6dfb2c6-e038-43b0-b2df-5cefa24b8534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:38.893509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:38.917822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e13913-8e69-4d8f-83b8-71275e8a75fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:38.918524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e13913-8e69-4d8f-83b8-71275e8a75fa None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.918807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e13913-8e69-4d8f-83b8-71275e8a75fa None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.919073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e13913-8e69-4d8f-83b8-71275e8a75fa None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.919878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e13913-8e69-4d8f-83b8-71275e8a75fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:38.920189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e13913-8e69-4d8f-83b8-71275e8a75fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:38.921737 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e13913-8e69-4d8f-83b8-71275e8a75fa None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:38.938503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 81/154] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:38.943824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e13913-8e69-4d8f-83b8-71275e8a75fa None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:39.039555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 74/155] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 00:19:39.041093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d1ce-12d9-4198-ae87-7f27607a5c2b None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:39.041391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d1ce-12d9-4198-ae87-7f27607a5c2b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:39.041669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d1ce-12d9-4198-ae87-7f27607a5c2b None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:39.048220 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 75/156] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:39.054394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18914880-5474-4acf-b0fe-a811e2936c06 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:39.054699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18914880-5474-4acf-b0fe-a811e2936c06 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:39.054979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18914880-5474-4acf-b0fe-a811e2936c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:39.085755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-18914880-5474-4acf-b0fe-a811e2936c06 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:39.086948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-18914880-5474-4acf-b0fe-a811e2936c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:39.146703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:39.211948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e13913-8e69-4d8f-83b8-71275e8a75fa None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:39.216762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 76/157] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:39.217885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18914880-5474-4acf-b0fe-a811e2936c06 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:39.278322 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da240399-20ff-4db7-a1ca-99d5c4d064b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:39.280803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da240399-20ff-4db7-a1ca-99d5c4d064b2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:39.281341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da240399-20ff-4db7-a1ca-99d5c4d064b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:39.285298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da240399-20ff-4db7-a1ca-99d5c4d064b2 None admin] PATH_INFO: `/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:39.288155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da240399-20ff-4db7-a1ca-99d5c4d064b2 None admin] RBAC: Authorizing `identity:get_user(user_id=b772abf551ba4a3bbcb1567e3ad5b88c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:39.289864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da240399-20ff-4db7-a1ca-99d5c4d064b2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:39.292072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 82/158] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:38 2022] GET /identity/v3/users/b772abf551ba4a3bbcb1567e3ad5b88c => generated 247 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:39.294731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da240399-20ff-4db7-a1ca-99d5c4d064b2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:39.342896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:39.399523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18914880-5474-4acf-b0fe-a811e2936c06 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:39.464892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e1a2-7eec-4cf9-a063-15feb3f5edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:39.467454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e1a2-7eec-4cf9-a063-15feb3f5edb9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:39.468117 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e1a2-7eec-4cf9-a063-15feb3f5edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:39.468812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e1a2-7eec-4cf9-a063-15feb3f5edb9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:39.492051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da240399-20ff-4db7-a1ca-99d5c4d064b2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:39.494960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33e1a2-7eec-4cf9-a063-15feb3f5edb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-5f33e1a2-7eec-4cf9-a063-15feb3f5edb9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:39.505418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:39.506602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:39.507364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:39.514276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 77/159] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:39.517499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e1a2-7eec-4cf9-a063-15feb3f5edb9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:39.553629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:39.561358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1354228-595a-4044-b5d9-a41cd249a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:39.566279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1354228-595a-4044-b5d9-a41cd249a1db None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:39.566279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1354228-595a-4044-b5d9-a41cd249a1db None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:39.566279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1354228-595a-4044-b5d9-a41cd249a1db None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:39.578722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1354228-595a-4044-b5d9-a41cd249a1db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b1354228-595a-4044-b5d9-a41cd249a1db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:39.589966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:39.591069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:39.591859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:39.594236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 83/160] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:39.595224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1354228-595a-4044-b5d9-a41cd249a1db None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:39.692209 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e1a2-7eec-4cf9-a063-15feb3f5edb9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:39.764677 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1354228-595a-4044-b5d9-a41cd249a1db None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:39.772055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:39.789374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e7af3-4a8b-42c2-98a0-3a1a93cd784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:39.795444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e7af3-4a8b-42c2-98a0-3a1a93cd784f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:39.795444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e7af3-4a8b-42c2-98a0-3a1a93cd784f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:39.795444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e7af3-4a8b-42c2-98a0-3a1a93cd784f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:39.815110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed265d1-7158-4109-a60d-8dac35a7a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:39.815819 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed265d1-7158-4109-a60d-8dac35a7a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:39.816105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed265d1-7158-4109-a60d-8dac35a7a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:39.816377 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed265d1-7158-4109-a60d-8dac35a7a5b6 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:39.817131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed265d1-7158-4109-a60d-8dac35a7a5b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:39.817435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed265d1-7158-4109-a60d-8dac35a7a5b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:39.818841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed265d1-7158-4109-a60d-8dac35a7a5b6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:39.836585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 84/161] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:39.837908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eecff-b302-4c36-b57a-2fc7755dd4fa None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:39.838210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eecff-b302-4c36-b57a-2fc7755dd4fa None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:39.838488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eecff-b302-4c36-b57a-2fc7755dd4fa None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:39.839726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 85/162] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:39.840441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eecff-b302-4c36-b57a-2fc7755dd4fa None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:39.919450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e7af3-4a8b-42c2-98a0-3a1a93cd784f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:39.921002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e7af3-4a8b-42c2-98a0-3a1a93cd784f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:39.925928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:40.015912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eecff-b302-4c36-b57a-2fc7755dd4fa None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:40.081495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f1cd8-340b-4870-b556-76d97338c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:40.082178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1cd8-340b-4870-b556-76d97338c820 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:40.082507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1cd8-340b-4870-b556-76d97338c820 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:40.082792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f1cd8-340b-4870-b556-76d97338c820 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:40.083548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f1cd8-340b-4870-b556-76d97338c820 None admin] RBAC: Adding query filter params (name=member) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:40.083897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f1cd8-340b-4870-b556-76d97338c820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:40.085295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f1cd8-340b-4870-b556-76d97338c820 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:40.097143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 86/163] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:40.098706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40501922-ce7a-49e5-8ac7-fbfa298466d6 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:40.099003 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40501922-ce7a-49e5-8ac7-fbfa298466d6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:40.099282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40501922-ce7a-49e5-8ac7-fbfa298466d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:40.122028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-40501922-ce7a-49e5-8ac7-fbfa298466d6 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:40.123238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-40501922-ce7a-49e5-8ac7-fbfa298466d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:40.128246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 78/164] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:40.129105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e7af3-4a8b-42c2-98a0-3a1a93cd784f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:40.192071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:40.245238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 87/165] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:40.245923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40501922-ce7a-49e5-8ac7-fbfa298466d6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:40.357877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e7af3-4a8b-42c2-98a0-3a1a93cd784f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:40.368084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:40.408537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40501922-ce7a-49e5-8ac7-fbfa298466d6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:40.444744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd42ef-8dc8-4f26-80eb-cc4f46fc2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:40.445621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd42ef-8dc8-4f26-80eb-cc4f46fc2b2b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:40.445901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd42ef-8dc8-4f26-80eb-cc4f46fc2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:40.446175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd42ef-8dc8-4f26-80eb-cc4f46fc2b2b None admin] PATH_INFO: `/v3/users/eaba8e0151814990a7ea9b84d6461ffd` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:40.447380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd42ef-8dc8-4f26-80eb-cc4f46fc2b2b None admin] RBAC: Authorizing `identity:get_user(user_id=eaba8e0151814990a7ea9b84d6461ffd)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:40.449007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd42ef-8dc8-4f26-80eb-cc4f46fc2b2b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:40.450941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 88/166] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:40 2022] GET /identity/v3/users/eaba8e0151814990a7ea9b84d6461ffd => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:40.451714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd42ef-8dc8-4f26-80eb-cc4f46fc2b2b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:40.540456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e254c-bacc-4004-a44c-794c96a674ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:40.541343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e254c-bacc-4004-a44c-794c96a674ee None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:40.541621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e254c-bacc-4004-a44c-794c96a674ee None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:40.541895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e254c-bacc-4004-a44c-794c96a674ee None admin] PATH_INFO: `/v3/users/0f273fb15f6c459194f34ae4de77eab3` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:40.543118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e254c-bacc-4004-a44c-794c96a674ee None admin] RBAC: Authorizing `identity:get_user(user_id=0f273fb15f6c459194f34ae4de77eab3)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:40.544607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e254c-bacc-4004-a44c-794c96a674ee None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:40.546880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 79/167] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:40 2022] GET /identity/v3/users/0f273fb15f6c459194f34ae4de77eab3 => generated 289 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:40.547639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e254c-bacc-4004-a44c-794c96a674ee None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:40.577082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd42ef-8dc8-4f26-80eb-cc4f46fc2b2b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:40.596139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:40.630688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fd13e-c4fd-431a-84da-d522fa44b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:40.630688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fd13e-c4fd-431a-84da-d522fa44b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:40.630688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fd13e-c4fd-431a-84da-d522fa44b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:40.630688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fd13e-c4fd-431a-84da-d522fa44b2b7 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:40.631076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fd13e-c4fd-431a-84da-d522fa44b2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:40.632208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fd13e-c4fd-431a-84da-d522fa44b2b7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:40.633950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 89/168] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:40 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:40.634714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fd13e-c4fd-431a-84da-d522fa44b2b7 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:40.667769 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:40.674835 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e254c-bacc-4004-a44c-794c96a674ee None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:40.720976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a38f5-1f50-4080-8dd3-edb8df9607f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:40.722569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a38f5-1f50-4080-8dd3-edb8df9607f5 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:40.723077 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a38f5-1f50-4080-8dd3-edb8df9607f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:40.723590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a38f5-1f50-4080-8dd3-edb8df9607f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:40.737619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a38f5-1f50-4080-8dd3-edb8df9607f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:40.748634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fd13e-c4fd-431a-84da-d522fa44b2b7 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-1c2a38f5-1f50-4080-8dd3-edb8df9607f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:40.748780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:40.749623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:40.750381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:40.758817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 80/169] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:19:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:40.760453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7ddf-5355-4e6c-90f0-26bbc753c3ba None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:40.761265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7ddf-5355-4e6c-90f0-26bbc753c3ba None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:40.761692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7ddf-5355-4e6c-90f0-26bbc753c3ba None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:40.763813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 81/170] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:40.764668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b7ddf-5355-4e6c-90f0-26bbc753c3ba None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:40.792845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3913c6-ca9a-4130-8506-b3f51a34d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:40.797601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3913c6-ca9a-4130-8506-b3f51a34d046 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:40.797601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3913c6-ca9a-4130-8506-b3f51a34d046 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:40.797601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3913c6-ca9a-4130-8506-b3f51a34d046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:40.857123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:40.878314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3913c6-ca9a-4130-8506-b3f51a34d046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:40.880023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3913c6-ca9a-4130-8506-b3f51a34d046 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:40.901488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b7ddf-5355-4e6c-90f0-26bbc753c3ba None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:40.950698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f41d4-ea25-4469-818a-deebe9d75977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:40.951996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f41d4-ea25-4469-818a-deebe9d75977 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:40.952976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f41d4-ea25-4469-818a-deebe9d75977 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:40.953944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f41d4-ea25-4469-818a-deebe9d75977 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:40.955549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f41d4-ea25-4469-818a-deebe9d75977 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:40.958115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f41d4-ea25-4469-818a-deebe9d75977 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:40.960014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 82/171] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:40 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:40.960925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f41d4-ea25-4469-818a-deebe9d75977 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:40.993089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:40.999560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 90/172] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:41.000651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3913c6-ca9a-4130-8506-b3f51a34d046 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:41.080460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f41d4-ea25-4469-818a-deebe9d75977 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:41.089594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:41.110257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3913c6-ca9a-4130-8506-b3f51a34d046 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:41.118804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd1836-c8a1-44ae-9835-030a387f5f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:41.119462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1836-c8a1-44ae-9835-030a387f5f32 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.119772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1836-c8a1-44ae-9835-030a387f5f32 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.120040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1836-c8a1-44ae-9835-030a387f5f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.120873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd1836-c8a1-44ae-9835-030a387f5f32 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945, user.id=b772abf551ba4a3bbcb1567e3ad5b88c) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:41.121181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd1836-c8a1-44ae-9835-030a387f5f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:41.122698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd1836-c8a1-44ae-9835-030a387f5f32 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:41.128849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 83/173] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:40 2022] GET /identity/v3/role_assignments?user.id=b772abf551ba4a3bbcb1567e3ad5b88c&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=635caa85d8524fb887206fd521defd3f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:41.130130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa06d8a-accb-4800-939a-755cdcded1fa None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.130418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa06d8a-accb-4800-939a-755cdcded1fa None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.130692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa06d8a-accb-4800-939a-755cdcded1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.149056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210db95-b4d5-45f8-ad08-8faa749537d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:41.149694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0aa06d8a-accb-4800-939a-755cdcded1fa None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:41.149824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210db95-b4d5-45f8-ad08-8faa749537d9 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.150010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210db95-b4d5-45f8-ad08-8faa749537d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.150277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210db95-b4d5-45f8-ad08-8faa749537d9 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.150939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0aa06d8a-accb-4800-939a-755cdcded1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:41.151044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210db95-b4d5-45f8-ad08-8faa749537d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:41.151329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210db95-b4d5-45f8-ad08-8faa749537d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:41.152872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210db95-b4d5-45f8-ad08-8faa749537d9 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:41.164157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 91/174] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:19:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:41.164809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210db95-b4d5-45f8-ad08-8faa749537d9 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:41.239756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 84/175] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:41.239756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f5590-2cbf-4e98-afcf-adb00d897326 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.239756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f5590-2cbf-4e98-afcf-adb00d897326 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.239756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f5590-2cbf-4e98-afcf-adb00d897326 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.239756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 85/176] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:41.239756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f5590-2cbf-4e98-afcf-adb00d897326 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:41.263197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:41.290731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210db95-b4d5-45f8-ad08-8faa749537d9 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:41.332967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a38a7-7ffa-40d1-bf18-020877b1a75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:41.333827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a38a7-7ffa-40d1-bf18-020877b1a75e None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.334266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a38a7-7ffa-40d1-bf18-020877b1a75e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.334697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a38a7-7ffa-40d1-bf18-020877b1a75e None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/users/0f273fb15f6c459194f34ae4de77eab3/roles/e68a59a8cda94903b57e7f58718fd182` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.337979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a38a7-7ffa-40d1-bf18-020877b1a75e None admin] RBAC: Authorizing `identity:create_grant(project_id=6999191d4ebb497fbaa576c8e3c1b945, user_id=0f273fb15f6c459194f34ae4de77eab3, role_id=e68a59a8cda94903b57e7f58718fd182)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:41.339161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a38a7-7ffa-40d1-bf18-020877b1a75e None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:41.353198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f5590-2cbf-4e98-afcf-adb00d897326 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:41.386659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499d27a-f23c-43d3-93e5-5a2a133a7e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:41.387546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d27a-f23c-43d3-93e5-5a2a133a7e13 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.387864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d27a-f23c-43d3-93e5-5a2a133a7e13 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.388145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d27a-f23c-43d3-93e5-5a2a133a7e13 None admin] PATH_INFO: `/v3/projects/3f8cab87614741a78e7f3aa21d39a43b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.389312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499d27a-f23c-43d3-93e5-5a2a133a7e13 None admin] RBAC: Authorizing `identity:get_project(project_id=3f8cab87614741a78e7f3aa21d39a43b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:41.391406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499d27a-f23c-43d3-93e5-5a2a133a7e13 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:41.393188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 86/177] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:41 2022] GET /identity/v3/projects/3f8cab87614741a78e7f3aa21d39a43b => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:41.397148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85336d8-ee66-453c-9d0d-457111833e19 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.397484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85336d8-ee66-453c-9d0d-457111833e19 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.397770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85336d8-ee66-453c-9d0d-457111833e19 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.399098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 87/178] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:41.403550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 92/179] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:19:41 2022] PUT /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/users/0f273fb15f6c459194f34ae4de77eab3/roles/e68a59a8cda94903b57e7f58718fd182 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:19:41.403715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85336d8-ee66-453c-9d0d-457111833e19 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:41.403837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa7760-fc94-4199-b2c1-af70c59ecd4e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.403837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa7760-fc94-4199-b2c1-af70c59ecd4e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.403837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa7760-fc94-4199-b2c1-af70c59ecd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.407762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:41.421273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c8aa7760-fc94-4199-b2c1-af70c59ecd4e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:41.422523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c8aa7760-fc94-4199-b2c1-af70c59ecd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:41.500431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 93/180] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:41.501126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa7760-fc94-4199-b2c1-af70c59ecd4e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:41.523769 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:41.538368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85336d8-ee66-453c-9d0d-457111833e19 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:41.583491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16cf00-0118-4181-a085-f7a246685c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:41.584557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16cf00-0118-4181-a085-f7a246685c1e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.584850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16cf00-0118-4181-a085-f7a246685c1e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.585115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16cf00-0118-4181-a085-f7a246685c1e None admin] PATH_INFO: `/v3/users/eaba8e0151814990a7ea9b84d6461ffd` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.586673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16cf00-0118-4181-a085-f7a246685c1e None admin] RBAC: Authorizing `identity:get_user(user_id=eaba8e0151814990a7ea9b84d6461ffd)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:41.588234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16cf00-0118-4181-a085-f7a246685c1e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:41.590024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 88/181] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:41 2022] GET /identity/v3/users/eaba8e0151814990a7ea9b84d6461ffd => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:41.590714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16cf00-0118-4181-a085-f7a246685c1e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:41.626191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa7760-fc94-4199-b2c1-af70c59ecd4e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:41.657816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:41.664137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481ee7d-540e-420b-9f4a-b7810a7134c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:41.666357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481ee7d-540e-420b-9f4a-b7810a7134c8 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.666811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481ee7d-540e-420b-9f4a-b7810a7134c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.667243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481ee7d-540e-420b-9f4a-b7810a7134c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.681409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481ee7d-540e-420b-9f4a-b7810a7134c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-0481ee7d-540e-420b-9f4a-b7810a7134c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:41.693391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:41.694391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:41.695165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:41.695764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 94/182] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:41.696698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95745621-1037-4219-9b61-da00d1cc7e38 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.696986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95745621-1037-4219-9b61-da00d1cc7e38 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.697328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95745621-1037-4219-9b61-da00d1cc7e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.702590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16cf00-0118-4181-a085-f7a246685c1e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:41.714150 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-95745621-1037-4219-9b61-da00d1cc7e38 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:41.715319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-95745621-1037-4219-9b61-da00d1cc7e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:41.741164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331e6c-aec0-476b-b981-7356dbd2730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:41.742262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331e6c-aec0-476b-b981-7356dbd2730c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.742819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331e6c-aec0-476b-b981-7356dbd2730c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.743101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331e6c-aec0-476b-b981-7356dbd2730c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.744219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12331e6c-aec0-476b-b981-7356dbd2730c None admin] RBAC: Adding query filter params (role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=3f8cab87614741a78e7f3aa21d39a43b, user.id=eaba8e0151814990a7ea9b84d6461ffd) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:41.744936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12331e6c-aec0-476b-b981-7356dbd2730c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:41.746677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12331e6c-aec0-476b-b981-7356dbd2730c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:41.753628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 89/183] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:41 2022] GET /identity/v3/role_assignments?user.id=eaba8e0151814990a7ea9b84d6461ffd&scope.project.id=3f8cab87614741a78e7f3aa21d39a43b&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:41.754429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331e6c-aec0-476b-b981-7356dbd2730c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:41.794820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:41.802415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 95/184] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:41.803695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95745621-1037-4219-9b61-da00d1cc7e38 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:41.908301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331e6c-aec0-476b-b981-7356dbd2730c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:41.925372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95745621-1037-4219-9b61-da00d1cc7e38 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:41.950040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698b6f1-a357-4b50-a587-5f2ef9396e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:41.950843 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698b6f1-a357-4b50-a587-5f2ef9396e95 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.951123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698b6f1-a357-4b50-a587-5f2ef9396e95 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.951396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698b6f1-a357-4b50-a587-5f2ef9396e95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:41.952937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698b6f1-a357-4b50-a587-5f2ef9396e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:41.954378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698b6f1-a357-4b50-a587-5f2ef9396e95 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:41.955117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:41.958554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 90/185] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:41.958554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698b6f1-a357-4b50-a587-5f2ef9396e95 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:41.967351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bc09b-83bb-4c61-93f3-f70b1815e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:41.968656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc09b-83bb-4c61-93f3-f70b1815e3ae None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:41.968866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc09b-83bb-4c61-93f3-f70b1815e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:41.969142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc09b-83bb-4c61-93f3-f70b1815e3ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.061255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:42.061823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bc09b-83bb-4c61-93f3-f70b1815e3ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:42.063326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bc09b-83bb-4c61-93f3-f70b1815e3ae None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:42.082414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698b6f1-a357-4b50-a587-5f2ef9396e95 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:42.125851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d453fb-a41c-43e5-87f9-68a8f6952415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:42.126528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d453fb-a41c-43e5-87f9-68a8f6952415 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.126811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d453fb-a41c-43e5-87f9-68a8f6952415 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.127087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d453fb-a41c-43e5-87f9-68a8f6952415 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.127864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d453fb-a41c-43e5-87f9-68a8f6952415 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:42.128180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d453fb-a41c-43e5-87f9-68a8f6952415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:42.129599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d453fb-a41c-43e5-87f9-68a8f6952415 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:42.142611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 91/186] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:42.142611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d453fb-a41c-43e5-87f9-68a8f6952415 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.173286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 96/187] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:42.173950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bc09b-83bb-4c61-93f3-f70b1815e3ae None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.199116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:42.255122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d453fb-a41c-43e5-87f9-68a8f6952415 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:42.276665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bc09b-83bb-4c61-93f3-f70b1815e3ae None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:42.291490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716322d6-132f-442e-9351-98fb22b91e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:42.292322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716322d6-132f-442e-9351-98fb22b91e2c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.292609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716322d6-132f-442e-9351-98fb22b91e2c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.292868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716322d6-132f-442e-9351-98fb22b91e2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.303955 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716322d6-132f-442e-9351-98fb22b91e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:42.311507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe095d-795e-48ab-b56d-dd8ba9d19dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:42.312239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe095d-795e-48ab-b56d-dd8ba9d19dd8 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.312524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe095d-795e-48ab-b56d-dd8ba9d19dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.312799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe095d-795e-48ab-b56d-dd8ba9d19dd8 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-716322d6-132f-442e-9351-98fb22b91e2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:42.312990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:42.313817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:42.314630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:42.315230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe095d-795e-48ab-b56d-dd8ba9d19dd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:42.315303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 92/188] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:19:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:42.315368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe095d-795e-48ab-b56d-dd8ba9d19dd8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:42.319676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716322d6-132f-442e-9351-98fb22b91e2c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.334820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:42.411760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 97/189] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:19:42 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:42.411760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe095d-795e-48ab-b56d-dd8ba9d19dd8 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.430694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716322d6-132f-442e-9351-98fb22b91e2c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:42.478942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171623d-b3d0-44f4-8f93-a7588850a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:42.479871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171623d-b3d0-44f4-8f93-a7588850a17d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.480155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171623d-b3d0-44f4-8f93-a7588850a17d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.480430 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171623d-b3d0-44f4-8f93-a7588850a17d None admin] PATH_INFO: `/v3/users/f471a0aab66b4ad0b5dc971c87505e7c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.497589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171623d-b3d0-44f4-8f93-a7588850a17d None admin] RBAC: Authorizing `identity:get_user(user_id=f471a0aab66b4ad0b5dc971c87505e7c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:42.499203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171623d-b3d0-44f4-8f93-a7588850a17d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:42.501392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 93/190] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:42 2022] GET /identity/v3/users/f471a0aab66b4ad0b5dc971c87505e7c => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:42.502231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171623d-b3d0-44f4-8f93-a7588850a17d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.517057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:42.546714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe095d-795e-48ab-b56d-dd8ba9d19dd8 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:42.586356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:42.589018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66919230-1730-4723-8ec4-3c30cbef3af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:42.589894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66919230-1730-4723-8ec4-3c30cbef3af1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.590178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66919230-1730-4723-8ec4-3c30cbef3af1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.590529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66919230-1730-4723-8ec4-3c30cbef3af1 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.591646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66919230-1730-4723-8ec4-3c30cbef3af1 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:42.594188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66919230-1730-4723-8ec4-3c30cbef3af1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:42.595919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 98/191] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:42 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:42.598235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66919230-1730-4723-8ec4-3c30cbef3af1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.630702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171623d-b3d0-44f4-8f93-a7588850a17d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:42.677105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8f9cb-34d8-43dd-b839-2965ab53458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:42.677812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8f9cb-34d8-43dd-b839-2965ab53458b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.678095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8f9cb-34d8-43dd-b839-2965ab53458b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.678427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8f9cb-34d8-43dd-b839-2965ab53458b None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.679177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8f9cb-34d8-43dd-b839-2965ab53458b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:42.679510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8f9cb-34d8-43dd-b839-2965ab53458b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:42.681009 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8f9cb-34d8-43dd-b839-2965ab53458b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:42.691679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 94/192] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:19:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:42.692541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8f9cb-34d8-43dd-b839-2965ab53458b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.729287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66919230-1730-4723-8ec4-3c30cbef3af1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:42.773766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660daf-f869-4558-b413-3662ec0ebe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:42.773766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660daf-f869-4558-b413-3662ec0ebe10 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.773766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660daf-f869-4558-b413-3662ec0ebe10 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.773766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660daf-f869-4558-b413-3662ec0ebe10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.796080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:42.828645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8f9cb-34d8-43dd-b839-2965ab53458b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:42.858796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8660daf-f869-4558-b413-3662ec0ebe10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:42.860739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:42.861620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8660daf-f869-4558-b413-3662ec0ebe10 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:42.866617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddc988-c1c0-4980-8273-1382b2b096d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:42.867277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddc988-c1c0-4980-8273-1382b2b096d2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.867565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddc988-c1c0-4980-8273-1382b2b096d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.867957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddc988-c1c0-4980-8273-1382b2b096d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.868801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddc988-c1c0-4980-8273-1382b2b096d2 None admin] RBAC: Adding query filter params (role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945, user.id=eaba8e0151814990a7ea9b84d6461ffd) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:42.869180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddc988-c1c0-4980-8273-1382b2b096d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:42.870694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddc988-c1c0-4980-8273-1382b2b096d2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:42.877764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 95/193] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:42 2022] GET /identity/v3/role_assignments?user.id=eaba8e0151814990a7ea9b84d6461ffd&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:42.878329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddc988-c1c0-4980-8273-1382b2b096d2 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.984636 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 99/194] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:42.990908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660daf-f869-4558-b413-3662ec0ebe10 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.992546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddc988-c1c0-4980-8273-1382b2b096d2 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:43.032853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e231e0d-40ee-459c-9b9a-b45e778edc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:43.033948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231e0d-40ee-459c-9b9a-b45e778edc29 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:43.034237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231e0d-40ee-459c-9b9a-b45e778edc29 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:43.034555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231e0d-40ee-459c-9b9a-b45e778edc29 None admin] PATH_INFO: `/v3/users/f471a0aab66b4ad0b5dc971c87505e7c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:43.036169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e231e0d-40ee-459c-9b9a-b45e778edc29 None admin] RBAC: Authorizing `identity:get_user(user_id=f471a0aab66b4ad0b5dc971c87505e7c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:43.044056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e231e0d-40ee-459c-9b9a-b45e778edc29 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:43.044056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 96/195] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:42 2022] GET /identity/v3/users/f471a0aab66b4ad0b5dc971c87505e7c => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:43.050618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e231e0d-40ee-459c-9b9a-b45e778edc29 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:43.110723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:43.191090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:43.248786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660daf-f869-4558-b413-3662ec0ebe10 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:43.270675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e231e0d-40ee-459c-9b9a-b45e778edc29 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:43.318272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f1092-ff5c-45d5-a42b-13881ac0de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:43.319561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f1092-ff5c-45d5-a42b-13881ac0de24 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:43.321024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f1092-ff5c-45d5-a42b-13881ac0de24 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:43.322125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f1092-ff5c-45d5-a42b-13881ac0de24 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:43.324097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f1092-ff5c-45d5-a42b-13881ac0de24 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:43.325888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f1092-ff5c-45d5-a42b-13881ac0de24 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:43.330348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 100/196] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:42 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:43.340937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f1092-ff5c-45d5-a42b-13881ac0de24 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:43.345303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04880976-ebe1-4940-bbe3-9da16e2468c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:43.347050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880976-ebe1-4940-bbe3-9da16e2468c9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:43.347595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880976-ebe1-4940-bbe3-9da16e2468c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:43.348106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880976-ebe1-4940-bbe3-9da16e2468c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:43.476478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04880976-ebe1-4940-bbe3-9da16e2468c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:43.478049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04880976-ebe1-4940-bbe3-9da16e2468c9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:43.485195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f1092-ff5c-45d5-a42b-13881ac0de24 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:43.500721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:43.542461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce181-99d5-4f60-bf86-e9d62f6641ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:43.543130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce181-99d5-4f60-bf86-e9d62f6641ac None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:43.543411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce181-99d5-4f60-bf86-e9d62f6641ac None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:43.543685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce181-99d5-4f60-bf86-e9d62f6641ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:43.544548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ce181-99d5-4f60-bf86-e9d62f6641ac None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=de248ef10d024a0087f98dbd00a26a29, user.id=f471a0aab66b4ad0b5dc971c87505e7c) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:43.544858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ce181-99d5-4f60-bf86-e9d62f6641ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:43.546459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ce181-99d5-4f60-bf86-e9d62f6641ac None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:43.560638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 101/197] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:43 2022] GET /identity/v3/role_assignments?user.id=f471a0aab66b4ad0b5dc971c87505e7c&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=635caa85d8524fb887206fd521defd3f => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:43.571951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:43.627842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 97/198] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:43.629686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce181-99d5-4f60-bf86-e9d62f6641ac None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:43.670601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577245-010a-4c18-b64c-eaee13f79d6a None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:43.671184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577245-010a-4c18-b64c-eaee13f79d6a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:43.671466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577245-010a-4c18-b64c-eaee13f79d6a None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:43.677465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 98/199] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:43.693979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128f65c-b452-4806-8612-ec386b925e87 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:43.694323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128f65c-b452-4806-8612-ec386b925e87 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:43.694531 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128f65c-b452-4806-8612-ec386b925e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:43.723530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b128f65c-b452-4806-8612-ec386b925e87 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:43.726598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b128f65c-b452-4806-8612-ec386b925e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:43.813185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce181-99d5-4f60-bf86-e9d62f6641ac None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:43.855786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 99/200] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:43.859804 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf481f3-234c-4be9-914a-db5547f0cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:43.859804 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf481f3-234c-4be9-914a-db5547f0cb6f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:43.859804 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf481f3-234c-4be9-914a-db5547f0cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:43.859804 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf481f3-234c-4be9-914a-db5547f0cb6f None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:43.863769 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf481f3-234c-4be9-914a-db5547f0cb6f None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:43.863769 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf481f3-234c-4be9-914a-db5547f0cb6f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:43.863949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 102/201] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:43 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:43.869705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128f65c-b452-4806-8612-ec386b925e87 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:43.884053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf481f3-234c-4be9-914a-db5547f0cb6f None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:43.953814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:44.047995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf481f3-234c-4be9-914a-db5547f0cb6f None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:44.058289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:44.072793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128f65c-b452-4806-8612-ec386b925e87 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:44.111931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb1eca-2dea-49b7-8b14-5b51f3c4a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:44.112742 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb1eca-2dea-49b7-8b14-5b51f3c4a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:44.113022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb1eca-2dea-49b7-8b14-5b51f3c4a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:44.113299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb1eca-2dea-49b7-8b14-5b51f3c4a4e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:44.135372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb1eca-2dea-49b7-8b14-5b51f3c4a4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-99eb1eca-2dea-49b7-8b14-5b51f3c4a4e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:44.143645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:44.144592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:44.145375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:44.145979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 103/202] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:44.149432 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821620d-4b36-429f-98b9-8b8a295627cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:44.150219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821620d-4b36-429f-98b9-8b8a295627cc None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:44.150557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821620d-4b36-429f-98b9-8b8a295627cc None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:44.150834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821620d-4b36-429f-98b9-8b8a295627cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:44.151719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821620d-4b36-429f-98b9-8b8a295627cc None admin] RBAC: Adding query filter params (role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=de248ef10d024a0087f98dbd00a26a29, user.id=f471a0aab66b4ad0b5dc971c87505e7c) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:44.152066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821620d-4b36-429f-98b9-8b8a295627cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:44.153574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821620d-4b36-429f-98b9-8b8a295627cc None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:44.157064 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb1eca-2dea-49b7-8b14-5b51f3c4a4e1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:44.163971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 100/203] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:43 2022] GET /identity/v3/role_assignments?user.id=f471a0aab66b4ad0b5dc971c87505e7c&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:44.279302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb1eca-2dea-49b7-8b14-5b51f3c4a4e1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:44.287169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:44.315614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8898d-95ff-4de3-a2d0-40d036b2d614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:44.316325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8898d-95ff-4de3-a2d0-40d036b2d614 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:44.316611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8898d-95ff-4de3-a2d0-40d036b2d614 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:44.316881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8898d-95ff-4de3-a2d0-40d036b2d614 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:44.317638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8898d-95ff-4de3-a2d0-40d036b2d614 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:44.317943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8898d-95ff-4de3-a2d0-40d036b2d614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:44.319366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8898d-95ff-4de3-a2d0-40d036b2d614 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:44.329992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 104/204] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:44.335429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821620d-4b36-429f-98b9-8b8a295627cc None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:44.467985 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821620d-4b36-429f-98b9-8b8a295627cc None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:44.502628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30723f73-e664-41f9-9ceb-0e42d1ad206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:44.503559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30723f73-e664-41f9-9ceb-0e42d1ad206d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:44.503867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30723f73-e664-41f9-9ceb-0e42d1ad206d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:44.504142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30723f73-e664-41f9-9ceb-0e42d1ad206d None admin] PATH_INFO: `/v3/users/0f273fb15f6c459194f34ae4de77eab3` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:44.506211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30723f73-e664-41f9-9ceb-0e42d1ad206d None admin] RBAC: Authorizing `identity:get_user(user_id=0f273fb15f6c459194f34ae4de77eab3)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:44.508561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30723f73-e664-41f9-9ceb-0e42d1ad206d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:44.510224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 101/205] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:44 2022] GET /identity/v3/users/0f273fb15f6c459194f34ae4de77eab3 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:44.516336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8898d-95ff-4de3-a2d0-40d036b2d614 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:44.623849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8898d-95ff-4de3-a2d0-40d036b2d614 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:44.660175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069836e5-2a6e-45d3-8721-2945ae7761b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:44.660833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069836e5-2a6e-45d3-8721-2945ae7761b3 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:44.661115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069836e5-2a6e-45d3-8721-2945ae7761b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:44.661391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069836e5-2a6e-45d3-8721-2945ae7761b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:44.698448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:44.732175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069836e5-2a6e-45d3-8721-2945ae7761b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:44.734243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069836e5-2a6e-45d3-8721-2945ae7761b3 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:44.834147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 105/206] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:19:44.839849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30723f73-e664-41f9-9ceb-0e42d1ad206d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:44.870151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:44.971072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30723f73-e664-41f9-9ceb-0e42d1ad206d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:45.012470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962f434-b53f-4a28-ac9d-3c3840257a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:45.013330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962f434-b53f-4a28-ac9d-3c3840257a1a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.013611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962f434-b53f-4a28-ac9d-3c3840257a1a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.013884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962f434-b53f-4a28-ac9d-3c3840257a1a None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.015085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962f434-b53f-4a28-ac9d-3c3840257a1a None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:45.016554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962f434-b53f-4a28-ac9d-3c3840257a1a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:45.025468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 102/207] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:44 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:45.025749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069836e5-2a6e-45d3-8721-2945ae7761b3 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:45.120787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:45.154491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069836e5-2a6e-45d3-8721-2945ae7761b3 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:45.190394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471bf30-c0a4-4401-bc5d-ecc5274da486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:45.191115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471bf30-c0a4-4401-bc5d-ecc5274da486 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.191394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471bf30-c0a4-4401-bc5d-ecc5274da486 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.191710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471bf30-c0a4-4401-bc5d-ecc5274da486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.192569 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471bf30-c0a4-4401-bc5d-ecc5274da486 None admin] RBAC: Adding query filter params (role.id=e68a59a8cda94903b57e7f58718fd182, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945, user.id=0f273fb15f6c459194f34ae4de77eab3) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:45.192878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471bf30-c0a4-4401-bc5d-ecc5274da486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:45.194333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471bf30-c0a4-4401-bc5d-ecc5274da486 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:45.200702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 106/208] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:45 2022] GET /identity/v3/role_assignments?user.id=0f273fb15f6c459194f34ae4de77eab3&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=e68a59a8cda94903b57e7f58718fd182 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:45.319855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac3266-5197-44eb-b6af-34ffa9367080 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.320198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac3266-5197-44eb-b6af-34ffa9367080 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.320408 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac3266-5197-44eb-b6af-34ffa9367080 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.322427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 103/209] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:45.328252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34efff-e615-48ba-9cff-48404482784f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.328540 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34efff-e615-48ba-9cff-48404482784f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.328814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34efff-e615-48ba-9cff-48404482784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.349638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ec34efff-e615-48ba-9cff-48404482784f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:45.350855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ec34efff-e615-48ba-9cff-48404482784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:45.432404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 107/210] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:45.466623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac3266-5197-44eb-b6af-34ffa9367080 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:45.469711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68974-2e2c-4f9f-b10b-d72642577006 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.469711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68974-2e2c-4f9f-b10b-d72642577006 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.469711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68974-2e2c-4f9f-b10b-d72642577006 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.469711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 108/211] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:45.476256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c937-d0cb-40ac-817d-7eca6cdf9fae None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.476764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c937-d0cb-40ac-817d-7eca6cdf9fae None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.477217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c937-d0cb-40ac-817d-7eca6cdf9fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.498987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-b6a1c937-d0cb-40ac-817d-7eca6cdf9fae None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:45.500211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b6a1c937-d0cb-40ac-817d-7eca6cdf9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:45.583907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 109/212] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:45.584210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:45.592461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:45.603487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac3266-5197-44eb-b6af-34ffa9367080 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:45.609204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c937-d0cb-40ac-817d-7eca6cdf9fae None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:45.639047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ca6f-7632-4624-9536-11675003f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:45.640442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ca6f-7632-4624-9536-11675003f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.640729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ca6f-7632-4624-9536-11675003f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.653859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ca6f-7632-4624-9536-11675003f9d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.653859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037ca6f-7632-4624-9536-11675003f9d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-c037ca6f-7632-4624-9536-11675003f9d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:45.660470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:45.661345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:45.662116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 104/213] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:45.668898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ca6f-7632-4624-9536-11675003f9d7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:45.719531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c937-d0cb-40ac-817d-7eca6cdf9fae None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:45.774031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3bfb0-33a4-4f76-a1ed-930763ae0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:45.775516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3bfb0-33a4-4f76-a1ed-930763ae0491 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.776333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3bfb0-33a4-4f76-a1ed-930763ae0491 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.776999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3bfb0-33a4-4f76-a1ed-930763ae0491 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.778567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3bfb0-33a4-4f76-a1ed-930763ae0491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:45.780955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3bfb0-33a4-4f76-a1ed-930763ae0491 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:45.783682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 110/214] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:45.789263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ca6f-7632-4624-9536-11675003f9d7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:45.791355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3bfb0-33a4-4f76-a1ed-930763ae0491 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:45.839602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e55b7-e9fa-4f83-9a6b-6a3e64c9a0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:45.841266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e55b7-e9fa-4f83-9a6b-6a3e64c9a0b6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.841702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e55b7-e9fa-4f83-9a6b-6a3e64c9a0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.842380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e55b7-e9fa-4f83-9a6b-6a3e64c9a0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.843562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e55b7-e9fa-4f83-9a6b-6a3e64c9a0b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:45.844133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e55b7-e9fa-4f83-9a6b-6a3e64c9a0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:45.846060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e55b7-e9fa-4f83-9a6b-6a3e64c9a0b6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:45.854597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:45.859665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 105/215] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:45.865567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e55b7-e9fa-4f83-9a6b-6a3e64c9a0b6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:45.885180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:45.900817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3bfb0-33a4-4f76-a1ed-930763ae0491 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:45.940380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb3e66-31ab-4e13-b19a-1a779ec229b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:45.941059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb3e66-31ab-4e13-b19a-1a779ec229b8 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.941340 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb3e66-31ab-4e13-b19a-1a779ec229b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.941610 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb3e66-31ab-4e13-b19a-1a779ec229b8 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.942316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb3e66-31ab-4e13-b19a-1a779ec229b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:45.943831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb3e66-31ab-4e13-b19a-1a779ec229b8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:45.980524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e55b7-e9fa-4f83-9a6b-6a3e64c9a0b6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:46.016170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6733bf5-9056-4ea6-b39c-d6ee15b3d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:46.017423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6733bf5-9056-4ea6-b39c-d6ee15b3d865 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.017929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6733bf5-9056-4ea6-b39c-d6ee15b3d865 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.018439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6733bf5-9056-4ea6-b39c-d6ee15b3d865 None admin] PATH_INFO: `/v3/users/98c594ad9d1c4bf19e4d07b99cbba851` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.034336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6733bf5-9056-4ea6-b39c-d6ee15b3d865 None admin] RBAC: Authorizing `identity:get_user(user_id=98c594ad9d1c4bf19e4d07b99cbba851)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:46.036409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6733bf5-9056-4ea6-b39c-d6ee15b3d865 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:46.038553 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 106/217] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:45 2022] GET /identity/v3/users/98c594ad9d1c4bf19e4d07b99cbba851 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:46.041586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 111/217] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:19:45 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:46.045018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6733bf5-9056-4ea6-b39c-d6ee15b3d865 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:46.127043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:46.164225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6733bf5-9056-4ea6-b39c-d6ee15b3d865 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:46.203872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4d7c9-9e92-4dd9-8173-ebfab2203bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:46.204535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d7c9-9e92-4dd9-8173-ebfab2203bf5 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.204821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d7c9-9e92-4dd9-8173-ebfab2203bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.205100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d7c9-9e92-4dd9-8173-ebfab2203bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.214450 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeafd0c-9947-4e53-9895-d6febab67645 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.214748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeafd0c-9947-4e53-9895-d6febab67645 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.215031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeafd0c-9947-4e53-9895-d6febab67645 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.216630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 112/218] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:46.222117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab8ad-452c-4a95-af1a-63eaef53ebdf None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.222679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab8ad-452c-4a95-af1a-63eaef53ebdf None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.222966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab8ad-452c-4a95-af1a-63eaef53ebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.245424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4acab8ad-452c-4a95-af1a-63eaef53ebdf None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:46.246973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4acab8ad-452c-4a95-af1a-63eaef53ebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:46.279509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4d7c9-9e92-4dd9-8173-ebfab2203bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:46.280306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4d7c9-9e92-4dd9-8173-ebfab2203bf5 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:46.332161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 113/219] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:46.354855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab8ad-452c-4a95-af1a-63eaef53ebdf None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:46.369336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:46.412299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 107/220] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:46.418256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4d7c9-9e92-4dd9-8173-ebfab2203bf5 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:46.429796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:46.494296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab8ad-452c-4a95-af1a-63eaef53ebdf None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:46.543761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4d7c9-9e92-4dd9-8173-ebfab2203bf5 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:46.552911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19fc79-4605-45bf-acfb-f59ac0d81a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:46.553998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19fc79-4605-45bf-acfb-f59ac0d81a45 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.554480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19fc79-4605-45bf-acfb-f59ac0d81a45 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.554955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19fc79-4605-45bf-acfb-f59ac0d81a45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.570807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19fc79-4605-45bf-acfb-f59ac0d81a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-0e19fc79-4605-45bf-acfb-f59ac0d81a45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:46.578917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:46.579797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:46.580566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:46.583002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 114/221] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:19:46.588888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19fc79-4605-45bf-acfb-f59ac0d81a45 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:46.634127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385502-d7f0-448f-bd63-4048e23e53f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:46.635854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385502-d7f0-448f-bd63-4048e23e53f2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.637110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385502-d7f0-448f-bd63-4048e23e53f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.638211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385502-d7f0-448f-bd63-4048e23e53f2 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.645037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00385502-d7f0-448f-bd63-4048e23e53f2 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:46.645037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00385502-d7f0-448f-bd63-4048e23e53f2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:46.645037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 108/222] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:46 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:46.651321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385502-d7f0-448f-bd63-4048e23e53f2 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:46.724406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:46.763768 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385502-d7f0-448f-bd63-4048e23e53f2 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:46.812546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19fc79-4605-45bf-acfb-f59ac0d81a45 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:46.822188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:46.833066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77534d3b-d52e-47a7-8114-57ad75f43575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:46.833948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77534d3b-d52e-47a7-8114-57ad75f43575 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.834232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77534d3b-d52e-47a7-8114-57ad75f43575 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.834508 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77534d3b-d52e-47a7-8114-57ad75f43575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.835349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77534d3b-d52e-47a7-8114-57ad75f43575 None admin] RBAC: Adding query filter params (role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=de248ef10d024a0087f98dbd00a26a29, user.id=98c594ad9d1c4bf19e4d07b99cbba851) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:46.835660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77534d3b-d52e-47a7-8114-57ad75f43575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:46.837133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77534d3b-d52e-47a7-8114-57ad75f43575 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:46.846678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 109/223] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:46 2022] GET /identity/v3/role_assignments?user.id=98c594ad9d1c4bf19e4d07b99cbba851&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:46.868155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729f6d2-b003-4ba1-b258-4c3a81455cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:46.875873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729f6d2-b003-4ba1-b258-4c3a81455cfe None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.875873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729f6d2-b003-4ba1-b258-4c3a81455cfe None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.875873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729f6d2-b003-4ba1-b258-4c3a81455cfe None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.875873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729f6d2-b003-4ba1-b258-4c3a81455cfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:46.875873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729f6d2-b003-4ba1-b258-4c3a81455cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:46.875873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729f6d2-b003-4ba1-b258-4c3a81455cfe None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:46.887636 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 115/224] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:46.893560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77534d3b-d52e-47a7-8114-57ad75f43575 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:46.967430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7ac30-81ee-4b63-a081-f3ca6fa007cc None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.967799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7ac30-81ee-4b63-a081-f3ca6fa007cc None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.968070 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7ac30-81ee-4b63-a081-f3ca6fa007cc None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.969845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 116/225] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:46.975054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d9c84-4c52-40b6-8aa5-e364671fdcf3 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:46.975308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d9c84-4c52-40b6-8aa5-e364671fdcf3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:46.975533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d9c84-4c52-40b6-8aa5-e364671fdcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:46.994336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-3e3d9c84-4c52-40b6-8aa5-e364671fdcf3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:46.995551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3e3d9c84-4c52-40b6-8aa5-e364671fdcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:47.044513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77534d3b-d52e-47a7-8114-57ad75f43575 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:47.048270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:47.073119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 117/226] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:47.087803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2feeb3-e827-4ac0-ac85-5cf224a030f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:47.089025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2feeb3-e827-4ac0-ac85-5cf224a030f4 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:47.089541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2feeb3-e827-4ac0-ac85-5cf224a030f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:47.090025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2feeb3-e827-4ac0-ac85-5cf224a030f4 None admin] PATH_INFO: `/v3/users/f471a0aab66b4ad0b5dc971c87505e7c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:47.093744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2feeb3-e827-4ac0-ac85-5cf224a030f4 None admin] RBAC: Authorizing `identity:get_user(user_id=f471a0aab66b4ad0b5dc971c87505e7c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:47.095487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2feeb3-e827-4ac0-ac85-5cf224a030f4 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:47.096483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d9c84-4c52-40b6-8aa5-e364671fdcf3 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:47.097696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 110/227] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:46 2022] GET /identity/v3/users/f471a0aab66b4ad0b5dc971c87505e7c => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:47.109389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2feeb3-e827-4ac0-ac85-5cf224a030f4 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:47.211358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2feeb3-e827-4ac0-ac85-5cf224a030f4 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:47.220086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:47.228111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d9c84-4c52-40b6-8aa5-e364671fdcf3 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:47.253167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89f71-cca2-471b-874e-daf459d72497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:47.254091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89f71-cca2-471b-874e-daf459d72497 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:47.255154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89f71-cca2-471b-874e-daf459d72497 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:47.255444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89f71-cca2-471b-874e-daf459d72497 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:47.257037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89f71-cca2-471b-874e-daf459d72497 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:47.258502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89f71-cca2-471b-874e-daf459d72497 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:47.262284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 111/228] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:47 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:47.273306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89f71-cca2-471b-874e-daf459d72497 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:47.298863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4f386-4eee-4d67-9fa6-2c79e8c91691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:47.299743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4f386-4eee-4d67-9fa6-2c79e8c91691 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:47.300031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4f386-4eee-4d67-9fa6-2c79e8c91691 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:47.300306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4f386-4eee-4d67-9fa6-2c79e8c91691 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:47.319505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4f386-4eee-4d67-9fa6-2c79e8c91691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-68f4f386-4eee-4d67-9fa6-2c79e8c91691 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:47.337328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:47.338202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:47.338979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:47.339571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 118/229] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:19:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:47.346747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4f386-4eee-4d67-9fa6-2c79e8c91691 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:47.352789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:47.473340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89f71-cca2-471b-874e-daf459d72497 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:47.523078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795d12c-c1bb-48e7-afaa-b371477a17d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:47.523930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795d12c-c1bb-48e7-afaa-b371477a17d6 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:47.524503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795d12c-c1bb-48e7-afaa-b371477a17d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:47.524927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795d12c-c1bb-48e7-afaa-b371477a17d6 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29/users/f471a0aab66b4ad0b5dc971c87505e7c/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:47.528176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795d12c-c1bb-48e7-afaa-b371477a17d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=de248ef10d024a0087f98dbd00a26a29, user_id=f471a0aab66b4ad0b5dc971c87505e7c, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:47.531318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795d12c-c1bb-48e7-afaa-b371477a17d6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:47.547976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4f386-4eee-4d67-9fa6-2c79e8c91691 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:47.582859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95001-7c05-45ff-9176-14faede119f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:47.583823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95001-7c05-45ff-9176-14faede119f1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:47.584276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95001-7c05-45ff-9176-14faede119f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:47.584694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95001-7c05-45ff-9176-14faede119f1 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:47.585691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95001-7c05-45ff-9176-14faede119f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:47.586144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95001-7c05-45ff-9176-14faede119f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:47.587901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95001-7c05-45ff-9176-14faede119f1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:47.597460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 119/230] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:19:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:47.607784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95001-7c05-45ff-9176-14faede119f1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:47.628172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:47.653859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 112/231] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:19:47 2022] PUT /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29/users/f471a0aab66b4ad0b5dc971c87505e7c/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:19:47.726580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95001-7c05-45ff-9176-14faede119f1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:47.765416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8a20e-6c27-44a9-9b26-4a4770d457b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:47.766316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8a20e-6c27-44a9-9b26-4a4770d457b1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:47.766597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8a20e-6c27-44a9-9b26-4a4770d457b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:47.766872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8a20e-6c27-44a9-9b26-4a4770d457b1 None admin] PATH_INFO: `/v3/users/f471a0aab66b4ad0b5dc971c87505e7c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:47.768167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8a20e-6c27-44a9-9b26-4a4770d457b1 None admin] RBAC: Authorizing `identity:get_user(user_id=f471a0aab66b4ad0b5dc971c87505e7c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:47.769672 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8a20e-6c27-44a9-9b26-4a4770d457b1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:47.771490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 120/232] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:47 2022] GET /identity/v3/users/f471a0aab66b4ad0b5dc971c87505e7c => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:47.777174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795d12c-c1bb-48e7-afaa-b371477a17d6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:47.893862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:47.897298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795d12c-c1bb-48e7-afaa-b371477a17d6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:47.932116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3652b-40f8-44a7-89f4-5eefacc071b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:47.932981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3652b-40f8-44a7-89f4-5eefacc071b7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:47.933262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3652b-40f8-44a7-89f4-5eefacc071b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:47.933539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3652b-40f8-44a7-89f4-5eefacc071b7 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:47.934766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3652b-40f8-44a7-89f4-5eefacc071b7 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:47.936280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3652b-40f8-44a7-89f4-5eefacc071b7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:47.938682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 113/233] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:47 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:47.944117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8a20e-6c27-44a9-9b26-4a4770d457b1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:48.060823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:48.076188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8a20e-6c27-44a9-9b26-4a4770d457b1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:48.121403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14e4b2-b2e7-4660-8228-1ea3595b95d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:48.122298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14e4b2-b2e7-4660-8228-1ea3595b95d1 None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:48.122583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14e4b2-b2e7-4660-8228-1ea3595b95d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:48.122862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14e4b2-b2e7-4660-8228-1ea3595b95d1 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29/users/f471a0aab66b4ad0b5dc971c87505e7c/roles/19d43474add64d77beb4f1d8b56a2740` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:48.125654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14e4b2-b2e7-4660-8228-1ea3595b95d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=de248ef10d024a0087f98dbd00a26a29, user_id=f471a0aab66b4ad0b5dc971c87505e7c, role_id=19d43474add64d77beb4f1d8b56a2740)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:48.127147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14e4b2-b2e7-4660-8228-1ea3595b95d1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:48.234347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 121/234] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:19:47 2022] PUT /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29/users/f471a0aab66b4ad0b5dc971c87505e7c/roles/19d43474add64d77beb4f1d8b56a2740 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:19:48.674278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684863cb-a16e-48d5-9e71-5791f2d2b041 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:48.674821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684863cb-a16e-48d5-9e71-5791f2d2b041 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:48.674821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684863cb-a16e-48d5-9e71-5791f2d2b041 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:48.676220 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 114/235] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:48.692212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ed195-f2dd-4a76-a73b-dd272b1dca92 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:48.692762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ed195-f2dd-4a76-a73b-dd272b1dca92 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:48.693245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ed195-f2dd-4a76-a73b-dd272b1dca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:48.720745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-540ed195-f2dd-4a76-a73b-dd272b1dca92 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:48.722333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-540ed195-f2dd-4a76-a73b-dd272b1dca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:48.793346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 122/236] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:48.829334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684863cb-a16e-48d5-9e71-5791f2d2b041 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:48.969363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684863cb-a16e-48d5-9e71-5791f2d2b041 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:49.007457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f0e8-8405-476c-8062-e5429de2ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:49.008652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f0e8-8405-476c-8062-e5429de2ac80 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.009126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f0e8-8405-476c-8062-e5429de2ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.009593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f0e8-8405-476c-8062-e5429de2ac80 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.020363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75f0e8-8405-476c-8062-e5429de2ac80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:49.027201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71614c6-2672-420a-8ce0-5a96349bc126 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.028095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71614c6-2672-420a-8ce0-5a96349bc126 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.028567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71614c6-2672-420a-8ce0-5a96349bc126 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.030712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 123/237] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-dc75f0e8-8405-476c-8062-e5429de2ac80 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:49.033894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:49.035013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:49.035839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:49.038047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b30b1-6189-4730-b318-b3e34ca70ea8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.038536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b30b1-6189-4730-b318-b3e34ca70ea8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.038999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b30b1-6189-4730-b318-b3e34ca70ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.042017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 115/238] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:49.048034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f0e8-8405-476c-8062-e5429de2ac80 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:49.067787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5e1b30b1-6189-4730-b318-b3e34ca70ea8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:49.068991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5e1b30b1-6189-4730-b318-b3e34ca70ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:49.096413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:49.190512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 124/239] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:49.210231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f0e8-8405-476c-8062-e5429de2ac80 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:49.239783 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b30b1-6189-4730-b318-b3e34ca70ea8 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:49.251249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd337e3-823d-47c2-984f-52ed43550190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:49.251957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd337e3-823d-47c2-984f-52ed43550190 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.252244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd337e3-823d-47c2-984f-52ed43550190 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.252777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd337e3-823d-47c2-984f-52ed43550190 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.253328 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd337e3-823d-47c2-984f-52ed43550190 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:49.253639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd337e3-823d-47c2-984f-52ed43550190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:49.255089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd337e3-823d-47c2-984f-52ed43550190 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:49.268099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:49.270697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 116/240] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:49.275721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd337e3-823d-47c2-984f-52ed43550190 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:49.344252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b30b1-6189-4730-b318-b3e34ca70ea8 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:49.378944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85676e2-866b-4d6e-9b3a-50838e3ee7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:49.380147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85676e2-866b-4d6e-9b3a-50838e3ee7dc None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.380627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85676e2-866b-4d6e-9b3a-50838e3ee7dc None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.381118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85676e2-866b-4d6e-9b3a-50838e3ee7dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.382733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85676e2-866b-4d6e-9b3a-50838e3ee7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:49.384442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85676e2-866b-4d6e-9b3a-50838e3ee7dc None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:49.386249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 125/241] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:49.396645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85676e2-866b-4d6e-9b3a-50838e3ee7dc None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:49.440372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:49.451650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd337e3-823d-47c2-984f-52ed43550190 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:49.491464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c1d0-fa3c-405d-bdf1-baa60eca12a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:49.492678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c1d0-fa3c-405d-bdf1-baa60eca12a9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.493206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c1d0-fa3c-405d-bdf1-baa60eca12a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.493712 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c1d0-fa3c-405d-bdf1-baa60eca12a9 None admin] PATH_INFO: `/v3/users/d7cbefd610d1476e8a6b77df130d498c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.517919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c1d0-fa3c-405d-bdf1-baa60eca12a9 None admin] RBAC: Authorizing `identity:get_user(user_id=d7cbefd610d1476e8a6b77df130d498c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:49.519389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c1d0-fa3c-405d-bdf1-baa60eca12a9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:49.521390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 117/242] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:49 2022] GET /identity/v3/users/d7cbefd610d1476e8a6b77df130d498c => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:49.526898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e7a7-a2de-47dc-ba79-a1789b6d0b83 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.526898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e7a7-a2de-47dc-ba79-a1789b6d0b83 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.526898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e7a7-a2de-47dc-ba79-a1789b6d0b83 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.526898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 118/243] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:49.529229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302e7a7-a2de-47dc-ba79-a1789b6d0b83 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:49.540117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:49.568219 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85676e2-866b-4d6e-9b3a-50838e3ee7dc None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:49.613087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90928ac-af3c-435d-84de-330efb8a0907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:49.614011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90928ac-af3c-435d-84de-330efb8a0907 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.614306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90928ac-af3c-435d-84de-330efb8a0907 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.614580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90928ac-af3c-435d-84de-330efb8a0907 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.615287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90928ac-af3c-435d-84de-330efb8a0907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:49.617549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90928ac-af3c-435d-84de-330efb8a0907 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:49.638609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302e7a7-a2de-47dc-ba79-a1789b6d0b83 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:49.674219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035734c4-91bc-48c3-a21e-3b74b174bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:49.674864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035734c4-91bc-48c3-a21e-3b74b174bad0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.675400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035734c4-91bc-48c3-a21e-3b74b174bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.675484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035734c4-91bc-48c3-a21e-3b74b174bad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.694497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:49.708810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 126/244] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:19:49 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:49.710450 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8612c9-bef7-42b0-b19c-01c3d06d0dde None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:49.710937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8612c9-bef7-42b0-b19c-01c3d06d0dde None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:49.711457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8612c9-bef7-42b0-b19c-01c3d06d0dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:49.754592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-cb8612c9-bef7-42b0-b19c-01c3d06d0dde None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:49.756234 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cb8612c9-bef7-42b0-b19c-01c3d06d0dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:49.810241 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035734c4-91bc-48c3-a21e-3b74b174bad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:49.812771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035734c4-91bc-48c3-a21e-3b74b174bad0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:49.913815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 127/245] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:49.948633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8612c9-bef7-42b0-b19c-01c3d06d0dde None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:49.959368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 119/246] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:49.966941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035734c4-91bc-48c3-a21e-3b74b174bad0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:50.017732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:50.043982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:50.090415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035734c4-91bc-48c3-a21e-3b74b174bad0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:50.105874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8612c9-bef7-42b0-b19c-01c3d06d0dde None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:50.140015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10960a-21ec-42f6-ab90-cd5e6e439627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:50.140865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10960a-21ec-42f6-ab90-cd5e6e439627 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.141143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10960a-21ec-42f6-ab90-cd5e6e439627 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.141423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10960a-21ec-42f6-ab90-cd5e6e439627 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.142603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10960a-21ec-42f6-ab90-cd5e6e439627 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:50.144641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10960a-21ec-42f6-ab90-cd5e6e439627 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:50.146676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 120/247] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:49 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:50.152140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10960a-21ec-42f6-ab90-cd5e6e439627 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:50.155897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a6a0-24cf-4f0e-8683-df4023c045b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:50.157716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a6a0-24cf-4f0e-8683-df4023c045b2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.158002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a6a0-24cf-4f0e-8683-df4023c045b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.158280 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a6a0-24cf-4f0e-8683-df4023c045b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.174207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17a6a0-24cf-4f0e-8683-df4023c045b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-cb17a6a0-24cf-4f0e-8683-df4023c045b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:50.183424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:50.184314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:50.185087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:50.185676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 128/248] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:19:50.192597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a6a0-24cf-4f0e-8683-df4023c045b2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:50.295396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10960a-21ec-42f6-ab90-cd5e6e439627 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:50.317904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:50.329480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a6a0-24cf-4f0e-8683-df4023c045b2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:50.345786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51943-2c16-466e-b73b-629114c81f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:50.346452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51943-2c16-466e-b73b-629114c81f70 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.347778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51943-2c16-466e-b73b-629114c81f70 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.347778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51943-2c16-466e-b73b-629114c81f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.348229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51943-2c16-466e-b73b-629114c81f70 None admin] RBAC: Adding query filter params (role.id=e68a59a8cda94903b57e7f58718fd182, scope.project.id=de248ef10d024a0087f98dbd00a26a29, user.id=d7cbefd610d1476e8a6b77df130d498c) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:50.348229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51943-2c16-466e-b73b-629114c81f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:50.349935 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51943-2c16-466e-b73b-629114c81f70 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:50.356593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 121/249] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:50 2022] GET /identity/v3/role_assignments?user.id=d7cbefd610d1476e8a6b77df130d498c&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=e68a59a8cda94903b57e7f58718fd182 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:50.357976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987b9f-de2d-4241-9f3f-ef83ecf4ac65 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.359181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987b9f-de2d-4241-9f3f-ef83ecf4ac65 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.359522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987b9f-de2d-4241-9f3f-ef83ecf4ac65 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.361023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:50.361411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 122/250] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:50.368298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe0251-fb4b-4b1c-a952-7cf3a4c41897 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.368647 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe0251-fb4b-4b1c-a952-7cf3a4c41897 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.368963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe0251-fb4b-4b1c-a952-7cf3a4c41897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.391477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3509482-d94a-46ed-a7bd-5003f2ba1e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:50.392228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509482-d94a-46ed-a7bd-5003f2ba1e4d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.392507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509482-d94a-46ed-a7bd-5003f2ba1e4d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.392805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509482-d94a-46ed-a7bd-5003f2ba1e4d None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.393559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509482-d94a-46ed-a7bd-5003f2ba1e4d None admin] RBAC: Adding query filter params (name=member) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:50.393866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509482-d94a-46ed-a7bd-5003f2ba1e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:50.395387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509482-d94a-46ed-a7bd-5003f2ba1e4d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:50.403957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b2fe0251-fb4b-4b1c-a952-7cf3a4c41897 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:50.405819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b2fe0251-fb4b-4b1c-a952-7cf3a4c41897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:50.417601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 129/251] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:50.424907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3509482-d94a-46ed-a7bd-5003f2ba1e4d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:50.552796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 123/252] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:50.562730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3509482-d94a-46ed-a7bd-5003f2ba1e4d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:50.593804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe0251-fb4b-4b1c-a952-7cf3a4c41897 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:50.611476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a58b4-a004-4595-8ca4-2b6ff435dc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:50.612415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a58b4-a004-4595-8ca4-2b6ff435dc9a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.612701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a58b4-a004-4595-8ca4-2b6ff435dc9a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.612976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a58b4-a004-4595-8ca4-2b6ff435dc9a None admin] PATH_INFO: `/v3/users/98c594ad9d1c4bf19e4d07b99cbba851` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.614205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a58b4-a004-4595-8ca4-2b6ff435dc9a None admin] RBAC: Authorizing `identity:get_user(user_id=98c594ad9d1c4bf19e4d07b99cbba851)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:50.615664 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a58b4-a004-4595-8ca4-2b6ff435dc9a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:50.618015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 130/253] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:50 2022] GET /identity/v3/users/98c594ad9d1c4bf19e4d07b99cbba851 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:50.623532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a58b4-a004-4595-8ca4-2b6ff435dc9a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:50.686171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:50.786608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a58b4-a004-4595-8ca4-2b6ff435dc9a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:50.793918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe0251-fb4b-4b1c-a952-7cf3a4c41897 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:50.815608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:50.856509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eaabc-8a47-4ae7-b172-f444f1d66d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:50.858159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eaabc-8a47-4ae7-b172-f444f1d66d47 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.858453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eaabc-8a47-4ae7-b172-f444f1d66d47 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.858728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eaabc-8a47-4ae7-b172-f444f1d66d47 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.860037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eaabc-8a47-4ae7-b172-f444f1d66d47 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:50.861512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eaabc-8a47-4ae7-b172-f444f1d66d47 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:50.863453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 131/254] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:50 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:50.864967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02903a0f-0bd2-433d-951b-893e32f5b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:50.865772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02903a0f-0bd2-433d-951b-893e32f5b882 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.866102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02903a0f-0bd2-433d-951b-893e32f5b882 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.866324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02903a0f-0bd2-433d-951b-893e32f5b882 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.869039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eaabc-8a47-4ae7-b172-f444f1d66d47 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:50.904402 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02903a0f-0bd2-433d-951b-893e32f5b882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-02903a0f-0bd2-433d-951b-893e32f5b882 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:50.912732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:50.913618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:50.914379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 124/255] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:19:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:19:50.921959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02903a0f-0bd2-433d-951b-893e32f5b882 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:51.078452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eaabc-8a47-4ae7-b172-f444f1d66d47 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:51.111451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02903a0f-0bd2-433d-951b-893e32f5b882 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:51.120147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:51.148626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f58796-0159-4c5b-96cc-253587109c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:51.149868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f58796-0159-4c5b-96cc-253587109c00 None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:51.150369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f58796-0159-4c5b-96cc-253587109c00 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:51.150820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f58796-0159-4c5b-96cc-253587109c00 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29/users/98c594ad9d1c4bf19e4d07b99cbba851/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:51.153913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f58796-0159-4c5b-96cc-253587109c00 None admin] RBAC: Authorizing `identity:create_grant(project_id=de248ef10d024a0087f98dbd00a26a29, user_id=98c594ad9d1c4bf19e4d07b99cbba851, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:51.155384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b565402-611d-4912-b7df-882457593a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:51.156000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f58796-0159-4c5b-96cc-253587109c00 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:51.156104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565402-611d-4912-b7df-882457593a3a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:51.156341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565402-611d-4912-b7df-882457593a3a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:51.156615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b565402-611d-4912-b7df-882457593a3a None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:51.157356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565402-611d-4912-b7df-882457593a3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:51.157658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565402-611d-4912-b7df-882457593a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:51.159025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b565402-611d-4912-b7df-882457593a3a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:51.171798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 125/256] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:51.177335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ba66-2d09-4fc5-934e-bd91a71b67c9 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:51.177787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ba66-2d09-4fc5-934e-bd91a71b67c9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:51.178221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ba66-2d09-4fc5-934e-bd91a71b67c9 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:51.182366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 126/257] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:51.182838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ba66-2d09-4fc5-934e-bd91a71b67c9 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:51.227578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 132/258] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:19:50 2022] PUT /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29/users/98c594ad9d1c4bf19e4d07b99cbba851/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:19:51.229292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a2b09-385b-4859-a8aa-af59eb9969ef None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:51.229777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a2b09-385b-4859-a8aa-af59eb9969ef None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:51.230293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a2b09-385b-4859-a8aa-af59eb9969ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:51.232677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:51.260668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-1a9a2b09-385b-4859-a8aa-af59eb9969ef None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:51.263116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1a9a2b09-385b-4859-a8aa-af59eb9969ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:51.380037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 133/259] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:51.393700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ba66-2d09-4fc5-934e-bd91a71b67c9 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:51.398957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a2b09-385b-4859-a8aa-af59eb9969ef None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:51.464815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84230ce-5fb4-4775-aa0d-5cb49d6fa7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:51.466075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84230ce-5fb4-4775-aa0d-5cb49d6fa7b6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:51.466554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84230ce-5fb4-4775-aa0d-5cb49d6fa7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:51.467060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84230ce-5fb4-4775-aa0d-5cb49d6fa7b6 None admin] PATH_INFO: `/v3/users/f471a0aab66b4ad0b5dc971c87505e7c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:51.468773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84230ce-5fb4-4775-aa0d-5cb49d6fa7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=f471a0aab66b4ad0b5dc971c87505e7c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:51.470462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84230ce-5fb4-4775-aa0d-5cb49d6fa7b6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:51.477052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 127/260] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:51 2022] GET /identity/v3/users/f471a0aab66b4ad0b5dc971c87505e7c => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:51.478440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84230ce-5fb4-4775-aa0d-5cb49d6fa7b6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:51.595261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a2b09-385b-4859-a8aa-af59eb9969ef None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:51.614319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:51.643322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:51.646180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84230ce-5fb4-4775-aa0d-5cb49d6fa7b6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:51.658707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d218a4-a6ff-4dc0-857d-a9a630e073f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:51.659527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d218a4-a6ff-4dc0-857d-a9a630e073f3 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:51.659831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d218a4-a6ff-4dc0-857d-a9a630e073f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:51.660110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d218a4-a6ff-4dc0-857d-a9a630e073f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:51.680866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d218a4-a6ff-4dc0-857d-a9a630e073f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-29d218a4-a6ff-4dc0-857d-a9a630e073f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:51.689075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:51.690157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:51.690923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 134/261] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:19:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:51.701638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d218a4-a6ff-4dc0-857d-a9a630e073f3 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:51.716216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1623c63-959f-48da-9f21-0767e2d70843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:51.716872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1623c63-959f-48da-9f21-0767e2d70843 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:51.717158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1623c63-959f-48da-9f21-0767e2d70843 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:51.717936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1623c63-959f-48da-9f21-0767e2d70843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:51.844600 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1623c63-959f-48da-9f21-0767e2d70843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:51.846090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1623c63-959f-48da-9f21-0767e2d70843 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:51.929814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d218a4-a6ff-4dc0-857d-a9a630e073f3 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:51.988151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:51.996262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 128/262] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:52.002504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1623c63-959f-48da-9f21-0767e2d70843 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:52.012656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfaf00-2f09-465e-b9af-218978bc32f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:52.013347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfaf00-2f09-465e-b9af-218978bc32f9 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.013635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfaf00-2f09-465e-b9af-218978bc32f9 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.013979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfaf00-2f09-465e-b9af-218978bc32f9 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.014780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfaf00-2f09-465e-b9af-218978bc32f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:52.015092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfaf00-2f09-465e-b9af-218978bc32f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:52.016557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfaf00-2f09-465e-b9af-218978bc32f9 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:52.035055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 135/263] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:19:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:52.040932 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfaf00-2f09-465e-b9af-218978bc32f9 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:52.137105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:52.140354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1623c63-959f-48da-9f21-0767e2d70843 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:52.177095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a618685-ffba-4b89-b36c-75d01fae9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:52.178246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a618685-ffba-4b89-b36c-75d01fae9e79 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.178692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a618685-ffba-4b89-b36c-75d01fae9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.179104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a618685-ffba-4b89-b36c-75d01fae9e79 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.180486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a618685-ffba-4b89-b36c-75d01fae9e79 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:52.182147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a618685-ffba-4b89-b36c-75d01fae9e79 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:52.184106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 129/264] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:52 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:52.190631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a618685-ffba-4b89-b36c-75d01fae9e79 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:52.251808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfaf00-2f09-465e-b9af-218978bc32f9 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:52.267579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:52.287397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610f50-27e9-4c3a-943f-38a739c6c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:52.288197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610f50-27e9-4c3a-943f-38a739c6c9e6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.288481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610f50-27e9-4c3a-943f-38a739c6c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.288759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610f50-27e9-4c3a-943f-38a739c6c9e6 None admin] PATH_INFO: `/v3/users/f471a0aab66b4ad0b5dc971c87505e7c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.290120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610f50-27e9-4c3a-943f-38a739c6c9e6 None admin] RBAC: Authorizing `identity:get_user(user_id=f471a0aab66b4ad0b5dc971c87505e7c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:52.291592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610f50-27e9-4c3a-943f-38a739c6c9e6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:52.293395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 136/265] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:52 2022] GET /identity/v3/users/f471a0aab66b4ad0b5dc971c87505e7c => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:52.298863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610f50-27e9-4c3a-943f-38a739c6c9e6 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:52.301106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a618685-ffba-4b89-b36c-75d01fae9e79 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:52.336946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61ca2b-93ee-43a0-84ac-2498e0e59d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:52.337933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ca2b-93ee-43a0-84ac-2498e0e59d1a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.338417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ca2b-93ee-43a0-84ac-2498e0e59d1a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.338909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ca2b-93ee-43a0-84ac-2498e0e59d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.339945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61ca2b-93ee-43a0-84ac-2498e0e59d1a None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=de248ef10d024a0087f98dbd00a26a29, user.id=f471a0aab66b4ad0b5dc971c87505e7c) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:52.340513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61ca2b-93ee-43a0-84ac-2498e0e59d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:52.342150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61ca2b-93ee-43a0-84ac-2498e0e59d1a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:52.349142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 130/266] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:52 2022] GET /identity/v3/role_assignments?user.id=f471a0aab66b4ad0b5dc971c87505e7c&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=635caa85d8524fb887206fd521defd3f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:52.411655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:52.414648 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610f50-27e9-4c3a-943f-38a739c6c9e6 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:52.453902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38186236-44c3-499a-98cd-efab7174a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:52.454485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186236-44c3-499a-98cd-efab7174a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.454772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186236-44c3-499a-98cd-efab7174a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.455152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186236-44c3-499a-98cd-efab7174a2d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.537111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38186236-44c3-499a-98cd-efab7174a2d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:52.538721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38186236-44c3-499a-98cd-efab7174a2d5 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:52.646217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:52.655298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 137/267] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:52.661317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61ca2b-93ee-43a0-84ac-2498e0e59d1a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:52.800526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61ca2b-93ee-43a0-84ac-2498e0e59d1a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:52.828852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:52.834031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e38a50-6347-460d-987d-aa75529b5284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:52.835115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e38a50-6347-460d-987d-aa75529b5284 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.835573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e38a50-6347-460d-987d-aa75529b5284 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.836179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e38a50-6347-460d-987d-aa75529b5284 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.837540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e38a50-6347-460d-987d-aa75529b5284 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:52.839162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e38a50-6347-460d-987d-aa75529b5284 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:52.841386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 131/268] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:52 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:52.847877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38186236-44c3-499a-98cd-efab7174a2d5 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:52.970119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38186236-44c3-499a-98cd-efab7174a2d5 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:53.019361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bcdc5-c623-44f9-8970-f695313c7836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:53.020082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bcdc5-c623-44f9-8970-f695313c7836 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.020366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bcdc5-c623-44f9-8970-f695313c7836 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.020643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bcdc5-c623-44f9-8970-f695313c7836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.021489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bcdc5-c623-44f9-8970-f695313c7836 None admin] RBAC: Adding query filter params (role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=de248ef10d024a0087f98dbd00a26a29, user.id=f471a0aab66b4ad0b5dc971c87505e7c) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:53.021803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bcdc5-c623-44f9-8970-f695313c7836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:53.028377 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bcdc5-c623-44f9-8970-f695313c7836 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:53.035094 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 138/269] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:52 2022] GET /identity/v3/role_assignments?user.id=f471a0aab66b4ad0b5dc971c87505e7c&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:53.040420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33cb3-e5ae-478e-b502-924a8a31ffea None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.041336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33cb3-e5ae-478e-b502-924a8a31ffea None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.041805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33cb3-e5ae-478e-b502-924a8a31ffea None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.043403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 132/270] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:53.049662 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822d6b8-a767-4844-a4d8-7bcc83947b28 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.049942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822d6b8-a767-4844-a4d8-7bcc83947b28 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.050223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822d6b8-a767-4844-a4d8-7bcc83947b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.074219 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-b822d6b8-a767-4844-a4d8-7bcc83947b28 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:53.075415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b822d6b8-a767-4844-a4d8-7bcc83947b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:53.160374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:53.173767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 139/271] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:53.200255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33cb3-e5ae-478e-b502-924a8a31ffea None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:53.333574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33cb3-e5ae-478e-b502-924a8a31ffea None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:53.369632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ae8f-0efa-41fa-89d7-337851a1dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:53.370425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ae8f-0efa-41fa-89d7-337851a1dc7c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.370703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ae8f-0efa-41fa-89d7-337851a1dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.370979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ae8f-0efa-41fa-89d7-337851a1dc7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.381988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ae8f-0efa-41fa-89d7-337851a1dc7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-fa10ae8f-0efa-41fa-89d7-337851a1dc7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:53.390145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:53.391072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:53.392348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 133/272] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:53.399246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822d6b8-a767-4844-a4d8-7bcc83947b28 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:53.465222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cc3ff-688c-4765-b444-898c3e372427 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.465541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cc3ff-688c-4765-b444-898c3e372427 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.465834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cc3ff-688c-4765-b444-898c3e372427 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.467219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 134/273] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:53.474276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e627ca-f94a-49d7-a9e8-dd9ab5b93fe1 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.474581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e627ca-f94a-49d7-a9e8-dd9ab5b93fe1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.474835 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e627ca-f94a-49d7-a9e8-dd9ab5b93fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.494474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c4e627ca-f94a-49d7-a9e8-dd9ab5b93fe1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:53.495039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c4e627ca-f94a-49d7-a9e8-dd9ab5b93fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:53.534013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822d6b8-a767-4844-a4d8-7bcc83947b28 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:53.559455 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:53.570358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6311c5-88b2-422e-982a-f37a77a4b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:53.571329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6311c5-88b2-422e-982a-f37a77a4b56b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.571792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6311c5-88b2-422e-982a-f37a77a4b56b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.577973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 135/274] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:53.578087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6311c5-88b2-422e-982a-f37a77a4b56b None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.578087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6311c5-88b2-422e-982a-f37a77a4b56b None admin] RBAC: Adding query filter params (name=member) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:53.578415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787750-48a1-4693-a693-2f3e3515054d None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.578506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6311c5-88b2-422e-982a-f37a77a4b56b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:53.578588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787750-48a1-4693-a693-2f3e3515054d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.578588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787750-48a1-4693-a693-2f3e3515054d None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.578715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6311c5-88b2-422e-982a-f37a77a4b56b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:53.578778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 136/275] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:53.582513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e4b3-7326-4c06-8a44-5b8b27731621 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.582805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e4b3-7326-4c06-8a44-5b8b27731621 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.583086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e4b3-7326-4c06-8a44-5b8b27731621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.586246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 140/276] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:53.591964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6311c5-88b2-422e-982a-f37a77a4b56b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:53.603085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3564e4b3-7326-4c06-8a44-5b8b27731621 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:53.604312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3564e4b3-7326-4c06-8a44-5b8b27731621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:53.650799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:53.676075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 137/277] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:53.676906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564e4b3-7326-4c06-8a44-5b8b27731621 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:53.705615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6311c5-88b2-422e-982a-f37a77a4b56b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:53.744762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e53c7e-28d0-4818-87ab-454104b77bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:53.745626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e53c7e-28d0-4818-87ab-454104b77bb7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.745903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e53c7e-28d0-4818-87ab-454104b77bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.746174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e53c7e-28d0-4818-87ab-454104b77bb7 None admin] PATH_INFO: `/v3/users/0f35d695c64a40539778a1b6d43001c2` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.762385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e53c7e-28d0-4818-87ab-454104b77bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=0f35d695c64a40539778a1b6d43001c2)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:53.763897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e53c7e-28d0-4818-87ab-454104b77bb7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:53.766134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 141/278] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:53 2022] GET /identity/v3/users/0f35d695c64a40539778a1b6d43001c2 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:53.766134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e53c7e-28d0-4818-87ab-454104b77bb7 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:53.784626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564e4b3-7326-4c06-8a44-5b8b27731621 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:53.805970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:53.820498 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550aae6-7957-4b30-a283-8b8370247fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:53.821371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550aae6-7957-4b30-a283-8b8370247fff None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.821725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550aae6-7957-4b30-a283-8b8370247fff None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.822006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550aae6-7957-4b30-a283-8b8370247fff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.832674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550aae6-7957-4b30-a283-8b8370247fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-9550aae6-7957-4b30-a283-8b8370247fff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:53.840946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:53.841996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:53.843504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:53.852238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 138/279] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:53.852238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550aae6-7957-4b30-a283-8b8370247fff None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:53.882182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e53c7e-28d0-4818-87ab-454104b77bb7 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:53.898577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:53.918228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5904f8f-abd1-42bd-b812-e4aa2c95fc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:53.919116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5904f8f-abd1-42bd-b812-e4aa2c95fc4c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.919597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5904f8f-abd1-42bd-b812-e4aa2c95fc4c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.920263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5904f8f-abd1-42bd-b812-e4aa2c95fc4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.922764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5904f8f-abd1-42bd-b812-e4aa2c95fc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:53.924261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5904f8f-abd1-42bd-b812-e4aa2c95fc4c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:53.926045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 142/280] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:53.926886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5904f8f-abd1-42bd-b812-e4aa2c95fc4c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:53.957337 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550aae6-7957-4b30-a283-8b8370247fff None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:53.995140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8d982-f5fe-4700-afbf-53bfbbe17454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:53.996144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8d982-f5fe-4700-afbf-53bfbbe17454 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.996647 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8d982-f5fe-4700-afbf-53bfbbe17454 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.997122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8d982-f5fe-4700-afbf-53bfbbe17454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.998160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8d982-f5fe-4700-afbf-53bfbbe17454 None admin] RBAC: Adding query filter params (role.id=83fe8b5fb84b42b298cd6be18a2d0759, user.id=0f35d695c64a40539778a1b6d43001c2, scope.system=all) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:53.999184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8d982-f5fe-4700-afbf-53bfbbe17454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:54.000643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8d982-f5fe-4700-afbf-53bfbbe17454 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:54.015763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 139/281] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jun 16 00:19:53 2022] GET /identity/v3/role_assignments?user.id=0f35d695c64a40539778a1b6d43001c2&scope.system=all&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:54.015763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8d982-f5fe-4700-afbf-53bfbbe17454 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:54.051326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5904f8f-abd1-42bd-b812-e4aa2c95fc4c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:54.093144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:54.097886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c1a32-5f89-4bb6-b4d5-b5121637d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:54.099410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c1a32-5f89-4bb6-b4d5-b5121637d63c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.100051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c1a32-5f89-4bb6-b4d5-b5121637d63c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.100515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c1a32-5f89-4bb6-b4d5-b5121637d63c None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.101454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c1a32-5f89-4bb6-b4d5-b5121637d63c None admin] RBAC: Adding query filter params (name=reader) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:54.102027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c1a32-5f89-4bb6-b4d5-b5121637d63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:54.104327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c1a32-5f89-4bb6-b4d5-b5121637d63c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:54.118326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 143/282] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:54.125074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c1a32-5f89-4bb6-b4d5-b5121637d63c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:54.147292 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8d982-f5fe-4700-afbf-53bfbbe17454 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:54.183664 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:54.189725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815a54e-aaef-4984-8cc8-c32bb0d02088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:54.190413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815a54e-aaef-4984-8cc8-c32bb0d02088 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.190698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815a54e-aaef-4984-8cc8-c32bb0d02088 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.190977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815a54e-aaef-4984-8cc8-c32bb0d02088 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.192203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815a54e-aaef-4984-8cc8-c32bb0d02088 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:54.194146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815a54e-aaef-4984-8cc8-c32bb0d02088 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:54.239480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c1a32-5f89-4bb6-b4d5-b5121637d63c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:54.273094 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675eb0b-f8dc-4f32-a1a4-89e3ec6e41b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:54.273976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675eb0b-f8dc-4f32-a1a4-89e3ec6e41b6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.274261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675eb0b-f8dc-4f32-a1a4-89e3ec6e41b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.274540 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675eb0b-f8dc-4f32-a1a4-89e3ec6e41b6 None admin] PATH_INFO: `/v3/users/d7cbefd610d1476e8a6b77df130d498c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.275718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675eb0b-f8dc-4f32-a1a4-89e3ec6e41b6 None admin] RBAC: Authorizing `identity:get_user(user_id=d7cbefd610d1476e8a6b77df130d498c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:54.277191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675eb0b-f8dc-4f32-a1a4-89e3ec6e41b6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:54.279199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 144/283] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:54 2022] GET /identity/v3/users/d7cbefd610d1476e8a6b77df130d498c => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:54.280440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f7939-b017-436a-adf2-e91fc0ef5abd None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.280722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f7939-b017-436a-adf2-e91fc0ef5abd None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.280997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f7939-b017-436a-adf2-e91fc0ef5abd None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.282402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 145/284] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:54.285050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f7939-b017-436a-adf2-e91fc0ef5abd None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:54.290250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 140/285] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:19:54 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:54.294372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f703f-f55b-41c2-abcf-e2cbbe78ef75 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.294372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f703f-f55b-41c2-abcf-e2cbbe78ef75 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.294372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f703f-f55b-41c2-abcf-e2cbbe78ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.317619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-bc2f703f-f55b-41c2-abcf-e2cbbe78ef75 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:54.319932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-bc2f703f-f55b-41c2-abcf-e2cbbe78ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:54.404266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f7939-b017-436a-adf2-e91fc0ef5abd None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:54.415407 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 141/286] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:54.419071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:54.440629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f703f-f55b-41c2-abcf-e2cbbe78ef75 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:54.446826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f82f71-bbdc-48ea-8021-b5236354e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:54.447764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f82f71-bbdc-48ea-8021-b5236354e230 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.448088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f82f71-bbdc-48ea-8021-b5236354e230 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.448365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f82f71-bbdc-48ea-8021-b5236354e230 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.449767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f82f71-bbdc-48ea-8021-b5236354e230 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:54.451334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f82f71-bbdc-48ea-8021-b5236354e230 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:54.453344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 146/287] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:54 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:54.459863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f82f71-bbdc-48ea-8021-b5236354e230 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:54.474817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:54.555256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f703f-f55b-41c2-abcf-e2cbbe78ef75 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:54.583477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f82f71-bbdc-48ea-8021-b5236354e230 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:54.596099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108aa7-3091-4217-8530-57cab530850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:54.596905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108aa7-3091-4217-8530-57cab530850e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.597184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108aa7-3091-4217-8530-57cab530850e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.597453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108aa7-3091-4217-8530-57cab530850e None admin] PATH_INFO: `/v3/roles/member` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.610491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47108aa7-3091-4217-8530-57cab530850e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-47108aa7-3091-4217-8530-57cab530850e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:54.619342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:54.620449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:54.621421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 142/288] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:19:54.627204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108aa7-3091-4217-8530-57cab530850e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:54.635120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14c7fa-e2ad-4247-853b-d5f04ae38011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:54.635120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14c7fa-e2ad-4247-853b-d5f04ae38011 None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.635120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14c7fa-e2ad-4247-853b-d5f04ae38011 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.635120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14c7fa-e2ad-4247-853b-d5f04ae38011 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29/users/d7cbefd610d1476e8a6b77df130d498c/roles/e68a59a8cda94903b57e7f58718fd182` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.637619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14c7fa-e2ad-4247-853b-d5f04ae38011 None admin] RBAC: Authorizing `identity:create_grant(project_id=de248ef10d024a0087f98dbd00a26a29, user_id=d7cbefd610d1476e8a6b77df130d498c, role_id=e68a59a8cda94903b57e7f58718fd182)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:54.639074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14c7fa-e2ad-4247-853b-d5f04ae38011 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:54.711232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 147/289] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:19:54 2022] PUT /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29/users/d7cbefd610d1476e8a6b77df130d498c/roles/e68a59a8cda94903b57e7f58718fd182 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:19:54.734739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:54.745620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108aa7-3091-4217-8530-57cab530850e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:54.783840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebadf0c-2074-463f-83b4-4cab5f206cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:54.784772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebadf0c-2074-463f-83b4-4cab5f206cbb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.785061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebadf0c-2074-463f-83b4-4cab5f206cbb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.785345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebadf0c-2074-463f-83b4-4cab5f206cbb None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.786310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebadf0c-2074-463f-83b4-4cab5f206cbb None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:54.786788 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebadf0c-2074-463f-83b4-4cab5f206cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:54.788600 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebadf0c-2074-463f-83b4-4cab5f206cbb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:54.801041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 143/290] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:54.806818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14c7fa-e2ad-4247-853b-d5f04ae38011 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:54.864869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:54.935649 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14c7fa-e2ad-4247-853b-d5f04ae38011 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:54.972858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81ec6e-d891-495b-8f47-58913b52e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:54.973665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81ec6e-d891-495b-8f47-58913b52e5c8 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.973976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81ec6e-d891-495b-8f47-58913b52e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.974258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81ec6e-d891-495b-8f47-58913b52e5c8 None admin] PATH_INFO: `/v3/users/98c594ad9d1c4bf19e4d07b99cbba851` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.975469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81ec6e-d891-495b-8f47-58913b52e5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=98c594ad9d1c4bf19e4d07b99cbba851)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:54.976967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81ec6e-d891-495b-8f47-58913b52e5c8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:54.980925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 148/291] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:54 2022] GET /identity/v3/users/98c594ad9d1c4bf19e4d07b99cbba851 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:54.984655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebadf0c-2074-463f-83b4-4cab5f206cbb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:55.096433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebadf0c-2074-463f-83b4-4cab5f206cbb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:55.147232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217f863-307c-47bf-b4dc-a816218cdc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:55.147916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217f863-307c-47bf-b4dc-a816218cdc7a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:55.148198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217f863-307c-47bf-b4dc-a816218cdc7a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:55.148472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217f863-307c-47bf-b4dc-a816218cdc7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:55.176429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:55.230094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217f863-307c-47bf-b4dc-a816218cdc7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:55.231495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217f863-307c-47bf-b4dc-a816218cdc7a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:55.336082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 144/292] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:55.344807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81ec6e-d891-495b-8f47-58913b52e5c8 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:55.491947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81ec6e-d891-495b-8f47-58913b52e5c8 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:55.501015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:55.535320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c06b6-8cc1-4710-80e2-3d6c6e8b90ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:55.536297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c06b6-8cc1-4710-80e2-3d6c6e8b90ae None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:55.536581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c06b6-8cc1-4710-80e2-3d6c6e8b90ae None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:55.536855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c06b6-8cc1-4710-80e2-3d6c6e8b90ae None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:55.540436 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c06b6-8cc1-4710-80e2-3d6c6e8b90ae None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:55.541946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c06b6-8cc1-4710-80e2-3d6c6e8b90ae None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:55.544363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 149/293] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:55 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:55.550801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217f863-307c-47bf-b4dc-a816218cdc7a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:55.614134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:55.666171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217f863-307c-47bf-b4dc-a816218cdc7a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:55.711990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3225bfb-1f6b-4857-a086-a392e666fadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:55.712648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3225bfb-1f6b-4857-a086-a392e666fadb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:55.712930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3225bfb-1f6b-4857-a086-a392e666fadb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:55.713203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3225bfb-1f6b-4857-a086-a392e666fadb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:55.714028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3225bfb-1f6b-4857-a086-a392e666fadb None admin] RBAC: Adding query filter params (role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=de248ef10d024a0087f98dbd00a26a29, user.id=98c594ad9d1c4bf19e4d07b99cbba851) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:55.714335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3225bfb-1f6b-4857-a086-a392e666fadb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:55.715791 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3225bfb-1f6b-4857-a086-a392e666fadb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:55.728883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 145/294] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:55 2022] GET /identity/v3/role_assignments?user.id=98c594ad9d1c4bf19e4d07b99cbba851&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:56.391509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06a730-1798-4915-aef0-437e203452f6 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.392116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06a730-1798-4915-aef0-437e203452f6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.392116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06a730-1798-4915-aef0-437e203452f6 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.393705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 150/295] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:56.399212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee1fd-6d46-4dd0-9ea0-f67fdbcf2373 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.399668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee1fd-6d46-4dd0-9ea0-f67fdbcf2373 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.399867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee1fd-6d46-4dd0-9ea0-f67fdbcf2373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.416817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3b8ee1fd-6d46-4dd0-9ea0-f67fdbcf2373 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:56.417997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3b8ee1fd-6d46-4dd0-9ea0-f67fdbcf2373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:56.499101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 146/296] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:19:56.516923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06a730-1798-4915-aef0-437e203452f6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:56.623006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06a730-1798-4915-aef0-437e203452f6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:56.662203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92380c47-dc9b-4fec-9aef-536dcc0f1ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:56.662974 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92380c47-dc9b-4fec-9aef-536dcc0f1ae2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.663264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92380c47-dc9b-4fec-9aef-536dcc0f1ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.663545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92380c47-dc9b-4fec-9aef-536dcc0f1ae2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.674720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92380c47-dc9b-4fec-9aef-536dcc0f1ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-92380c47-dc9b-4fec-9aef-536dcc0f1ae2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:56.682702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:56.684792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:56.687283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 151/297] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:56.692639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ee1fd-6d46-4dd0-9ea0-f67fdbcf2373 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:56.737871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:56.791859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ee1fd-6d46-4dd0-9ea0-f67fdbcf2373 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:56.828045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67aea3-63f8-4662-a05c-1b59e955b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:56.828720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67aea3-63f8-4662-a05c-1b59e955b297 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.829001 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67aea3-63f8-4662-a05c-1b59e955b297 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.829278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67aea3-63f8-4662-a05c-1b59e955b297 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.830082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67aea3-63f8-4662-a05c-1b59e955b297 None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:56.830393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67aea3-63f8-4662-a05c-1b59e955b297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:56.831777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67aea3-63f8-4662-a05c-1b59e955b297 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:56.843896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 147/298] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:56.846635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92380c47-dc9b-4fec-9aef-536dcc0f1ae2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:56.883605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:56.951250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92380c47-dc9b-4fec-9aef-536dcc0f1ae2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:56.985415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7dd2d-3a1e-475b-9188-ca4d57016188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:56.986301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7dd2d-3a1e-475b-9188-ca4d57016188 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.986582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7dd2d-3a1e-475b-9188-ca4d57016188 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.986862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7dd2d-3a1e-475b-9188-ca4d57016188 None admin] PATH_INFO: `/v3/users/0f35d695c64a40539778a1b6d43001c2` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.988097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7dd2d-3a1e-475b-9188-ca4d57016188 None admin] RBAC: Authorizing `identity:get_user(user_id=0f35d695c64a40539778a1b6d43001c2)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:56.989555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7dd2d-3a1e-475b-9188-ca4d57016188 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:56.991187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 152/299] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:56 2022] GET /identity/v3/users/0f35d695c64a40539778a1b6d43001c2 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:56.996767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67aea3-63f8-4662-a05c-1b59e955b297 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.107066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67aea3-63f8-4662-a05c-1b59e955b297 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:57.117272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:57.141069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33a7f0-f764-43b2-9720-82d862cca176 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.141712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33a7f0-f764-43b2-9720-82d862cca176 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.141946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae4729-02b6-4fb0-bfb1-e5a8bea31175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:57.142477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33a7f0-f764-43b2-9720-82d862cca176 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.142808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae4729-02b6-4fb0-bfb1-e5a8bea31175 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.143094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae4729-02b6-4fb0-bfb1-e5a8bea31175 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.143370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae4729-02b6-4fb0-bfb1-e5a8bea31175 None admin] PATH_INFO: `/v3/system/users/0f35d695c64a40539778a1b6d43001c2/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.144711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 153/300] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:57.144886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae4729-02b6-4fb0-bfb1-e5a8bea31175 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0f35d695c64a40539778a1b6d43001c2, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:57.148902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae4729-02b6-4fb0-bfb1-e5a8bea31175 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:57.149693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79bb05-4063-4572-8fbb-b679df05ad65 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.150481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79bb05-4063-4572-8fbb-b679df05ad65 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.150794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79bb05-4063-4572-8fbb-b679df05ad65 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.152112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 154/301] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:57.153375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdb865-485f-4809-9441-9116fb61aaba None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.153659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdb865-485f-4809-9441-9116fb61aaba None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.153931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdb865-485f-4809-9441-9116fb61aaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.171638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a4bdb865-485f-4809-9441-9116fb61aaba None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:57.172925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a4bdb865-485f-4809-9441-9116fb61aaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:57.231934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 148/302] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Jun 16 00:19:56 2022] PUT /identity/v3/system/users/0f35d695c64a40539778a1b6d43001c2/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:19:57.231934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d55450-b73f-4fdc-bbf3-86b9d9112d18 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.231934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d55450-b73f-4fdc-bbf3-86b9d9112d18 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.231934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d55450-b73f-4fdc-bbf3-86b9d9112d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.252101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 155/303] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:57.253107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-54d55450-b73f-4fdc-bbf3-86b9d9112d18 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:57.254617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-54d55450-b73f-4fdc-bbf3-86b9d9112d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:57.270498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b932-b50e-4754-a4e3-5a5d070c193b None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.270786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b932-b50e-4754-a4e3-5a5d070c193b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.271071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b932-b50e-4754-a4e3-5a5d070c193b None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.272529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 156/304] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:57.277383 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b932-b50e-4754-a4e3-5a5d070c193b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.316498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:57.339547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 149/305] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:57.341079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218a38c-b634-4f9b-8973-c07bccefc073 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.341436 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218a38c-b634-4f9b-8973-c07bccefc073 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.341785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218a38c-b634-4f9b-8973-c07bccefc073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.366977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c218a38c-b634-4f9b-8973-c07bccefc073 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:57.368749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c218a38c-b634-4f9b-8973-c07bccefc073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:57.399465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b932-b50e-4754-a4e3-5a5d070c193b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:57.433538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8de8db-6f51-45fd-a30e-262fca831167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:57.434346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8de8db-6f51-45fd-a30e-262fca831167 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.434627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8de8db-6f51-45fd-a30e-262fca831167 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.434914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8de8db-6f51-45fd-a30e-262fca831167 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.444790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 150/306] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:57.445242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8de8db-6f51-45fd-a30e-262fca831167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:57.445436 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218a38c-b634-4f9b-8973-c07bccefc073 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-fa8de8db-6f51-45fd-a30e-262fca831167 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:57.453621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:57.454479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:57.455259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:57.459768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 157/307] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:57.460839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8de8db-6f51-45fd-a30e-262fca831167 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.485020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:57.554055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218a38c-b634-4f9b-8973-c07bccefc073 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:57.561580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:57.570000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8de8db-6f51-45fd-a30e-262fca831167 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:57.588989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da218891-711f-4cda-a677-f4a143872f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:57.589779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da218891-711f-4cda-a677-f4a143872f30 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.590059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da218891-711f-4cda-a677-f4a143872f30 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.590338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da218891-711f-4cda-a677-f4a143872f30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.591482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da218891-711f-4cda-a677-f4a143872f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:57.593639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da218891-711f-4cda-a677-f4a143872f30 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:57.595256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 151/308] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:57.596039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da218891-711f-4cda-a677-f4a143872f30 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.616072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c3bea-d86d-4a3a-ba0d-6c2c9106de7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:57.616741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c3bea-d86d-4a3a-ba0d-6c2c9106de7c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.617020 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c3bea-d86d-4a3a-ba0d-6c2c9106de7c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.617300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c3bea-d86d-4a3a-ba0d-6c2c9106de7c None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.618034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c3bea-d86d-4a3a-ba0d-6c2c9106de7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:57.618604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c3bea-d86d-4a3a-ba0d-6c2c9106de7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:57.619913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c3bea-d86d-4a3a-ba0d-6c2c9106de7c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:57.628955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 158/309] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:57.629749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c3bea-d86d-4a3a-ba0d-6c2c9106de7c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.707979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:57.711023 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da218891-711f-4cda-a677-f4a143872f30 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:57.737021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c3bea-d86d-4a3a-ba0d-6c2c9106de7c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:57.746949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40396fe-0430-4b4b-94c3-f9f8ed30f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:57.748083 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40396fe-0430-4b4b-94c3-f9f8ed30f4bf None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.748374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40396fe-0430-4b4b-94c3-f9f8ed30f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.748840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40396fe-0430-4b4b-94c3-f9f8ed30f4bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.759940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40396fe-0430-4b4b-94c3-f9f8ed30f4bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-b40396fe-0430-4b4b-94c3-f9f8ed30f4bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:57.767830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:57.768902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:19:57.769828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 152/310] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:57.770576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40396fe-0430-4b4b-94c3-f9f8ed30f4bf None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.777366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888237b-cc78-49a4-8b3d-99479fccbde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:57.778040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888237b-cc78-49a4-8b3d-99479fccbde2 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.778326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888237b-cc78-49a4-8b3d-99479fccbde2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.778605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888237b-cc78-49a4-8b3d-99479fccbde2 None admin] PATH_INFO: `/v3/groups` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.779347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888237b-cc78-49a4-8b3d-99479fccbde2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:57.781474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888237b-cc78-49a4-8b3d-99479fccbde2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:57.871885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40396fe-0430-4b4b-94c3-f9f8ed30f4bf None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:57.904227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0fc9-d1c9-4a6f-a955-19e1078a0c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:57.905638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0fc9-d1c9-4a6f-a955-19e1078a0c66 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.905917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0fc9-d1c9-4a6f-a955-19e1078a0c66 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.906191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b0fc9-d1c9-4a6f-a955-19e1078a0c66 None admin] PATH_INFO: `/v3/users/a76f1ef8ce614388a5197f2f1be8c2ae` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.919558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b0fc9-d1c9-4a6f-a955-19e1078a0c66 None admin] RBAC: Authorizing `identity:get_user(user_id=a76f1ef8ce614388a5197f2f1be8c2ae)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:57.921651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b0fc9-d1c9-4a6f-a955-19e1078a0c66 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:57.923357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 153/311] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:57 2022] GET /identity/v3/users/a76f1ef8ce614388a5197f2f1be8c2ae => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:57.928325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0fc9-d1c9-4a6f-a955-19e1078a0c66 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.935857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 159/312] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Jun 16 00:19:57 2022] POST /identity/v3/groups => generated 229 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:19:57.935857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888237b-cc78-49a4-8b3d-99479fccbde2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.953310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:57.961899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:58.053886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b0fc9-d1c9-4a6f-a955-19e1078a0c66 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:58.063169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888237b-cc78-49a4-8b3d-99479fccbde2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:58.102739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482d414-86e8-4d74-817d-c4d9d6b2dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:58.103695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482d414-86e8-4d74-817d-c4d9d6b2dc9b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:58.104250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482d414-86e8-4d74-817d-c4d9d6b2dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:58.104669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482d414-86e8-4d74-817d-c4d9d6b2dc9b None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:58.105568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482d414-86e8-4d74-817d-c4d9d6b2dc9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:58.106019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482d414-86e8-4d74-817d-c4d9d6b2dc9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:58.107039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8de9b1-62c0-4ac8-9514-d14d4ed15be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:58.107813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482d414-86e8-4d74-817d-c4d9d6b2dc9b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:58.107976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8de9b1-62c0-4ac8-9514-d14d4ed15be0 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:58.108363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8de9b1-62c0-4ac8-9514-d14d4ed15be0 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:58.108740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8de9b1-62c0-4ac8-9514-d14d4ed15be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:58.109685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8de9b1-62c0-4ac8-9514-d14d4ed15be0 None admin] RBAC: Adding query filter params (role.id=e68a59a8cda94903b57e7f58718fd182, user.id=a76f1ef8ce614388a5197f2f1be8c2ae, scope.system=all) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:58.110239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8de9b1-62c0-4ac8-9514-d14d4ed15be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:58.111931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8de9b1-62c0-4ac8-9514-d14d4ed15be0 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:58.117704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 160/313] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jun 16 00:19:57 2022] GET /identity/v3/role_assignments?user.id=a76f1ef8ce614388a5197f2f1be8c2ae&scope.system=all&role.id=e68a59a8cda94903b57e7f58718fd182 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:58.119356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 154/314] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:58.125031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8de9b1-62c0-4ac8-9514-d14d4ed15be0 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:58.219052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:58.239451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8de9b1-62c0-4ac8-9514-d14d4ed15be0 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:58.278745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2516cc4-76dd-4d98-b219-a22f28f7e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:58.280525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2516cc4-76dd-4d98-b219-a22f28f7e82b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:58.280953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2516cc4-76dd-4d98-b219-a22f28f7e82b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:58.281384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2516cc4-76dd-4d98-b219-a22f28f7e82b None admin] PATH_INFO: `/v3/users/d7cbefd610d1476e8a6b77df130d498c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:58.282756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2516cc4-76dd-4d98-b219-a22f28f7e82b None admin] RBAC: Authorizing `identity:get_user(user_id=d7cbefd610d1476e8a6b77df130d498c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:58.284441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2516cc4-76dd-4d98-b219-a22f28f7e82b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:58.286620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 161/315] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:58 2022] GET /identity/v3/users/d7cbefd610d1476e8a6b77df130d498c => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:58.292224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482d414-86e8-4d74-817d-c4d9d6b2dc9b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:58.377699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:58.397308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482d414-86e8-4d74-817d-c4d9d6b2dc9b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:58.437172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9f43-bcfb-4dff-9d2f-376e87fca8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:58.437831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9f43-bcfb-4dff-9d2f-376e87fca8b8 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:58.438121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9f43-bcfb-4dff-9d2f-376e87fca8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:58.438400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9f43-bcfb-4dff-9d2f-376e87fca8b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:58.508227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d9f43-bcfb-4dff-9d2f-376e87fca8b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:58.509714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d9f43-bcfb-4dff-9d2f-376e87fca8b8 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:58.597394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:58.610020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 155/316] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:58.615703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2516cc4-76dd-4d98-b219-a22f28f7e82b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:58.726441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2516cc4-76dd-4d98-b219-a22f28f7e82b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:58.761477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435208e-9196-4317-b440-22cc39ac4157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:58.762646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435208e-9196-4317-b440-22cc39ac4157 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:58.763104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435208e-9196-4317-b440-22cc39ac4157 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:58.763552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435208e-9196-4317-b440-22cc39ac4157 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:58.765669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435208e-9196-4317-b440-22cc39ac4157 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:58.767307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435208e-9196-4317-b440-22cc39ac4157 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:58.769520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 162/317] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:19:58 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:58.778557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9f43-bcfb-4dff-9d2f-376e87fca8b8 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:58.879600 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9f43-bcfb-4dff-9d2f-376e87fca8b8 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:58.914667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdd7ec-2cb9-4521-a3fe-fcebee43f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:58.915373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd7ec-2cb9-4521-a3fe-fcebee43f29a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:58.915669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd7ec-2cb9-4521-a3fe-fcebee43f29a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:58.915977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd7ec-2cb9-4521-a3fe-fcebee43f29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:58.916819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdd7ec-2cb9-4521-a3fe-fcebee43f29a None admin] RBAC: Adding query filter params (role.id=e68a59a8cda94903b57e7f58718fd182, scope.project.id=de248ef10d024a0087f98dbd00a26a29, user.id=d7cbefd610d1476e8a6b77df130d498c) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:58.917133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdd7ec-2cb9-4521-a3fe-fcebee43f29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:58.918568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdd7ec-2cb9-4521-a3fe-fcebee43f29a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:58.925660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 156/318] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:19:58 2022] GET /identity/v3/role_assignments?user.id=d7cbefd610d1476e8a6b77df130d498c&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=e68a59a8cda94903b57e7f58718fd182 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:59.390833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cf6ce-bdec-4bad-8011-d16f57d1b16e None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:59.391170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cf6ce-bdec-4bad-8011-d16f57d1b16e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:59.391501 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cf6ce-bdec-4bad-8011-d16f57d1b16e None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:59.393057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 163/319] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:59.397898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70efcf-ea24-4015-8ed4-2ee7b49e2b59 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:59.398197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70efcf-ea24-4015-8ed4-2ee7b49e2b59 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:59.398477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70efcf-ea24-4015-8ed4-2ee7b49e2b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:59.415530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-fc70efcf-ea24-4015-8ed4-2ee7b49e2b59 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:59.416736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-fc70efcf-ea24-4015-8ed4-2ee7b49e2b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:59.456907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:59.482551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 157/320] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:19:59.505519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cf6ce-bdec-4bad-8011-d16f57d1b16e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:59.524625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:59.610140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cf6ce-bdec-4bad-8011-d16f57d1b16e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:59.644999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624929-27dc-4c10-8f3d-ce19c6459159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:59.645740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624929-27dc-4c10-8f3d-ce19c6459159 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:59.646008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624929-27dc-4c10-8f3d-ce19c6459159 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:59.646285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624929-27dc-4c10-8f3d-ce19c6459159 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:59.657266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58624929-27dc-4c10-8f3d-ce19c6459159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-58624929-27dc-4c10-8f3d-ce19c6459159 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:19:59.664993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:19:59.665826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:19:59.666581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:19:59.667198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 164/321] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:19:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:19:59.673004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70efcf-ea24-4015-8ed4-2ee7b49e2b59 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:59.781024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70efcf-ea24-4015-8ed4-2ee7b49e2b59 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:59.814473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff8b2-8353-4dc3-a5ec-ecdf75331bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:59.815144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff8b2-8353-4dc3-a5ec-ecdf75331bc7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:59.815473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff8b2-8353-4dc3-a5ec-ecdf75331bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:59.815811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff8b2-8353-4dc3-a5ec-ecdf75331bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:59.816562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff8b2-8353-4dc3-a5ec-ecdf75331bc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:19:59.816873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff8b2-8353-4dc3-a5ec-ecdf75331bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:59.818260 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff8b2-8353-4dc3-a5ec-ecdf75331bc7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:59.831952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 158/322] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:19:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:19:59.839762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624929-27dc-4c10-8f3d-ce19c6459159 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:59.912899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:59.935342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624929-27dc-4c10-8f3d-ce19c6459159 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:59.970004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51fe80-2de2-431e-87ba-582f7fd3bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:59.970883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51fe80-2de2-431e-87ba-582f7fd3bfec None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:59.971168 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51fe80-2de2-431e-87ba-582f7fd3bfec None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:59.971447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51fe80-2de2-431e-87ba-582f7fd3bfec None admin] PATH_INFO: `/v3/users/0f35d695c64a40539778a1b6d43001c2` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:59.972671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51fe80-2de2-431e-87ba-582f7fd3bfec None admin] RBAC: Authorizing `identity:get_user(user_id=0f35d695c64a40539778a1b6d43001c2)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:59.974132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51fe80-2de2-431e-87ba-582f7fd3bfec None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:59.975948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 165/323] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:19:59 2022] GET /identity/v3/users/0f35d695c64a40539778a1b6d43001c2 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:19:59.981425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff8b2-8353-4dc3-a5ec-ecdf75331bc7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:00.017523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:00.088674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff8b2-8353-4dc3-a5ec-ecdf75331bc7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:00.121143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b254ef-91d5-40d2-8eb4-9aa5595e5ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:00.121805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b254ef-91d5-40d2-8eb4-9aa5595e5ccb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.122085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b254ef-91d5-40d2-8eb4-9aa5595e5ccb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.122364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b254ef-91d5-40d2-8eb4-9aa5595e5ccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.123187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b254ef-91d5-40d2-8eb4-9aa5595e5ccb None admin] RBAC: Adding query filter params (role.id=83fe8b5fb84b42b298cd6be18a2d0759, user.id=0f35d695c64a40539778a1b6d43001c2, scope.system=all) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:00.124036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b254ef-91d5-40d2-8eb4-9aa5595e5ccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:00.125487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b254ef-91d5-40d2-8eb4-9aa5595e5ccb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:00.137423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 159/324] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jun 16 00:19:59 2022] GET /identity/v3/role_assignments?user.id=0f35d695c64a40539778a1b6d43001c2&scope.system=all&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 510 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:00.227510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed859-fbc2-467d-870c-d797d8a58af4 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.227838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed859-fbc2-467d-870c-d797d8a58af4 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.228034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed859-fbc2-467d-870c-d797d8a58af4 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.229628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 166/325] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:00.235308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ca86-a38b-4ed4-ba55-8624954ed657 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.235640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ca86-a38b-4ed4-ba55-8624954ed657 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.235924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ca86-a38b-4ed4-ba55-8624954ed657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.251340 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259f7d8-765d-41ae-b9bf-343083d541b5 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.251628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259f7d8-765d-41ae-b9bf-343083d541b5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.251940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259f7d8-765d-41ae-b9bf-343083d541b5 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.253318 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 167/326] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:00.258121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9840ca86-a38b-4ed4-ba55-8624954ed657 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:00.259018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30765afa-29b7-458c-befa-e1a89bed8c11 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.259309 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30765afa-29b7-458c-befa-e1a89bed8c11 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.259587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30765afa-29b7-458c-befa-e1a89bed8c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.260253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9840ca86-a38b-4ed4-ba55-8624954ed657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:00.277503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-30765afa-29b7-458c-befa-e1a89bed8c11 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:00.278752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-30765afa-29b7-458c-befa-e1a89bed8c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:00.339824 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 160/327] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:00.362201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 168/328] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:20:00.362774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ca86-a38b-4ed4-ba55-8624954ed657 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:00.386521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30765afa-29b7-458c-befa-e1a89bed8c11 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:00.388415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:00.459273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:00.459963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ca86-a38b-4ed4-ba55-8624954ed657 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:00.484052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30765afa-29b7-458c-befa-e1a89bed8c11 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:00.493375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249d5f-1417-4953-bcb8-d030e9be40cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:00.494160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249d5f-1417-4953-bcb8-d030e9be40cb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.494452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249d5f-1417-4953-bcb8-d030e9be40cb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.494733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249d5f-1417-4953-bcb8-d030e9be40cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.495915 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8249d5f-1417-4953-bcb8-d030e9be40cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:00.497355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8249d5f-1417-4953-bcb8-d030e9be40cb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:00.499608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 161/329] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:00.505038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249d5f-1417-4953-bcb8-d030e9be40cb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:00.518063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d70a3-a89b-4075-bb18-c17e8029499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:00.518859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d70a3-a89b-4075-bb18-c17e8029499e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.519148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d70a3-a89b-4075-bb18-c17e8029499e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.519426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d70a3-a89b-4075-bb18-c17e8029499e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.529350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d70a3-a89b-4075-bb18-c17e8029499e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-a72d70a3-a89b-4075-bb18-c17e8029499e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:00.537046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:00.537908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:00.538900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 169/330] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:00.543958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d70a3-a89b-4075-bb18-c17e8029499e None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:00.592810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:00.603376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249d5f-1417-4953-bcb8-d030e9be40cb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:00.639245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b800ec-aa34-4d10-ba12-1044bf1f0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:00.639942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b800ec-aa34-4d10-ba12-1044bf1f0ba0 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.640237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b800ec-aa34-4d10-ba12-1044bf1f0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.640514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b800ec-aa34-4d10-ba12-1044bf1f0ba0 None admin] PATH_INFO: `/v3/groups` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.641196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b800ec-aa34-4d10-ba12-1044bf1f0ba0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:00.642640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b800ec-aa34-4d10-ba12-1044bf1f0ba0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:00.643155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d70a3-a89b-4075-bb18-c17e8029499e None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:00.676182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b9b5e-3b67-435c-9aba-7d1bbf7ba4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:00.676843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b9b5e-3b67-435c-9aba-7d1bbf7ba4cf None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.677128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b9b5e-3b67-435c-9aba-7d1bbf7ba4cf None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.677462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b9b5e-3b67-435c-9aba-7d1bbf7ba4cf None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.678205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b9b5e-3b67-435c-9aba-7d1bbf7ba4cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:00.678515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b9b5e-3b67-435c-9aba-7d1bbf7ba4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:00.679931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b9b5e-3b67-435c-9aba-7d1bbf7ba4cf None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:00.681269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:00.688727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 170/331] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:20:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:00.700074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b9b5e-3b67-435c-9aba-7d1bbf7ba4cf None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:00.724827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 162/332] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Jun 16 00:20:00 2022] POST /identity/v3/groups => generated 226 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:20:00.801319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b9b5e-3b67-435c-9aba-7d1bbf7ba4cf None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:00.836882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b0a59-9af2-42e4-8e6f-aec9c77ce4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:00.837930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b0a59-9af2-42e4-8e6f-aec9c77ce4b3 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.838211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b0a59-9af2-42e4-8e6f-aec9c77ce4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.838488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b0a59-9af2-42e4-8e6f-aec9c77ce4b3 None admin] PATH_INFO: `/v3/users/a76f1ef8ce614388a5197f2f1be8c2ae` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.839791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b0a59-9af2-42e4-8e6f-aec9c77ce4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=a76f1ef8ce614388a5197f2f1be8c2ae)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:00.841271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b0a59-9af2-42e4-8e6f-aec9c77ce4b3 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:00.843666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 171/333] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:20:00 2022] GET /identity/v3/users/a76f1ef8ce614388a5197f2f1be8c2ae => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:00.849589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b800ec-aa34-4d10-ba12-1044bf1f0ba0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:00.993713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b800ec-aa34-4d10-ba12-1044bf1f0ba0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:01.028410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c8590-caed-4fd6-85f1-973945357e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:01.029295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c8590-caed-4fd6-85f1-973945357e6c None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:01.030146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c8590-caed-4fd6-85f1-973945357e6c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:01.030400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c8590-caed-4fd6-85f1-973945357e6c None admin] PATH_INFO: `/v3/system/users/a76f1ef8ce614388a5197f2f1be8c2ae/roles/e68a59a8cda94903b57e7f58718fd182` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:01.031951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c8590-caed-4fd6-85f1-973945357e6c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a76f1ef8ce614388a5197f2f1be8c2ae, role_id=e68a59a8cda94903b57e7f58718fd182)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:01.033363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c8590-caed-4fd6-85f1-973945357e6c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:01.091547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 163/334] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Jun 16 00:20:00 2022] PUT /identity/v3/system/users/a76f1ef8ce614388a5197f2f1be8c2ae/roles/e68a59a8cda94903b57e7f58718fd182 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:03.054773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4074fb6-a5ac-47de-840d-41a55dbe9bb9 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.055505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4074fb6-a5ac-47de-840d-41a55dbe9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.055505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4074fb6-a5ac-47de-840d-41a55dbe9bb9 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.056739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 172/335] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:03.063270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a02ab5-4f68-4f77-ab3e-9686668620b2 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.063687 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a02ab5-4f68-4f77-ab3e-9686668620b2 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.063931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a02ab5-4f68-4f77-ab3e-9686668620b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.081461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-62a02ab5-4f68-4f77-ab3e-9686668620b2 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:03.082648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-62a02ab5-4f68-4f77-ab3e-9686668620b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:03.094007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:03.159242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 164/336] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:03.182250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4074fb6-a5ac-47de-840d-41a55dbe9bb9 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:03.250896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:03.291185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4074fb6-a5ac-47de-840d-41a55dbe9bb9 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:03.328062 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645cfe-e9fc-4537-9ba7-f5723ea706b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:03.328866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645cfe-e9fc-4537-9ba7-f5723ea706b7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.329147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645cfe-e9fc-4537-9ba7-f5723ea706b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.329418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645cfe-e9fc-4537-9ba7-f5723ea706b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.339935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94645cfe-e9fc-4537-9ba7-f5723ea706b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-94645cfe-e9fc-4537-9ba7-f5723ea706b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:03.347755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:03.349860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:03.351855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 173/337] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:03.359765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a02ab5-4f68-4f77-ab3e-9686668620b2 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:03.460882 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a02ab5-4f68-4f77-ab3e-9686668620b2 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:03.496437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e91c6-ee33-4e1d-bf5d-440a812bf953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:03.497108 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e91c6-ee33-4e1d-bf5d-440a812bf953 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.497390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e91c6-ee33-4e1d-bf5d-440a812bf953 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.497669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e91c6-ee33-4e1d-bf5d-440a812bf953 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.498984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e91c6-ee33-4e1d-bf5d-440a812bf953 None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:03.499292 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e91c6-ee33-4e1d-bf5d-440a812bf953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:03.500724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e91c6-ee33-4e1d-bf5d-440a812bf953 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:03.509763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 165/338] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:20:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:03.515271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645cfe-e9fc-4537-9ba7-f5723ea706b7 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:03.524679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d251744-819a-4ba9-8fa5-04094cdcfb20 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.524679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d251744-819a-4ba9-8fa5-04094cdcfb20 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.524679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d251744-819a-4ba9-8fa5-04094cdcfb20 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.524679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 166/339] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:03.532263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f072e-a445-48ef-aa63-3e0f94e6a5f8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.532757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f072e-a445-48ef-aa63-3e0f94e6a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.533177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f072e-a445-48ef-aa63-3e0f94e6a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.560399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-620f072e-a445-48ef-aa63-3e0f94e6a5f8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:03.562250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-620f072e-a445-48ef-aa63-3e0f94e6a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:03.580085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:03.690822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 167/340] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:20:03.703919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645cfe-e9fc-4537-9ba7-f5723ea706b7 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:03.723825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f072e-a445-48ef-aa63-3e0f94e6a5f8 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:03.736105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:03.752738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023c384-f905-4c64-ab2e-cc6d354c2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:03.753410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023c384-f905-4c64-ab2e-cc6d354c2c29 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.753690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023c384-f905-4c64-ab2e-cc6d354c2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.753966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023c384-f905-4c64-ab2e-cc6d354c2c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.860947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023c384-f905-4c64-ab2e-cc6d354c2c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:03.862690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023c384-f905-4c64-ab2e-cc6d354c2c29 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:03.893690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f072e-a445-48ef-aa63-3e0f94e6a5f8 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:03.933081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c07a8-c1bf-4921-9013-c06d76b508f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:03.937473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c07a8-c1bf-4921-9013-c06d76b508f4 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.938016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c07a8-c1bf-4921-9013-c06d76b508f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.938464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c07a8-c1bf-4921-9013-c06d76b508f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.949306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:03.953203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c07a8-c1bf-4921-9013-c06d76b508f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-b85c07a8-c1bf-4921-9013-c06d76b508f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:03.962386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:03.963377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 168/341] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:20:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:03.973017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e170b5-b9d9-400b-8a7c-b3ca8053f33f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.973750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e170b5-b9d9-400b-8a7c-b3ca8053f33f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.973750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e170b5-b9d9-400b-8a7c-b3ca8053f33f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.973750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 169/342] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:03.976362 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88bf8b-aa7e-456b-a670-8c544790321e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.976804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88bf8b-aa7e-456b-a670-8c544790321e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.977247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88bf8b-aa7e-456b-a670-8c544790321e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.984040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 174/343] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:03.985434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023c384-f905-4c64-ab2e-cc6d354c2c29 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.005096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ac88bf8b-aa7e-456b-a670-8c544790321e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:04.007082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ac88bf8b-aa7e-456b-a670-8c544790321e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:04.020165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:04.112694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 170/344] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:04.113639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88bf8b-aa7e-456b-a670-8c544790321e None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.141732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023c384-f905-4c64-ab2e-cc6d354c2c29 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:04.219213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36fba6-eb57-41de-8602-b4e6954c41de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:04.219916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36fba6-eb57-41de-8602-b4e6954c41de None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.221263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36fba6-eb57-41de-8602-b4e6954c41de None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.221543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36fba6-eb57-41de-8602-b4e6954c41de None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.222312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36fba6-eb57-41de-8602-b4e6954c41de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:04.222621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36fba6-eb57-41de-8602-b4e6954c41de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:04.224166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36fba6-eb57-41de-8602-b4e6954c41de None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:04.233935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 175/345] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:04.234581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36fba6-eb57-41de-8602-b4e6954c41de None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.278866 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88bf8b-aa7e-456b-a670-8c544790321e None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:04.310441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:04.319634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6005d-5542-4e50-8666-68ef5d10810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:04.320831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6005d-5542-4e50-8666-68ef5d10810d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.321339 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6005d-5542-4e50-8666-68ef5d10810d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.321837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6005d-5542-4e50-8666-68ef5d10810d None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.323429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6005d-5542-4e50-8666-68ef5d10810d None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:04.325229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6005d-5542-4e50-8666-68ef5d10810d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:04.327439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 171/346] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:04.335885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659239-fbf0-477e-b47b-0cf9bd731e92 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.335885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659239-fbf0-477e-b47b-0cf9bd731e92 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.335885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659239-fbf0-477e-b47b-0cf9bd731e92 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.335885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 172/347] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:04.336479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0659239-fbf0-477e-b47b-0cf9bd731e92 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.339758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:04.356036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36fba6-eb57-41de-8602-b4e6954c41de None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:04.394058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2336bd-91f9-49c7-bb51-5c4f070193f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:04.394768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2336bd-91f9-49c7-bb51-5c4f070193f6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.395048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2336bd-91f9-49c7-bb51-5c4f070193f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.395326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2336bd-91f9-49c7-bb51-5c4f070193f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.406940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2336bd-91f9-49c7-bb51-5c4f070193f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-bc2336bd-91f9-49c7-bb51-5c4f070193f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:04.415381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:04.416360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:04.417166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 176/348] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:04.417825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138a449-81c8-4a01-ac51-7fe77d4e612a None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.418108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138a449-81c8-4a01-ac51-7fe77d4e612a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.418340 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138a449-81c8-4a01-ac51-7fe77d4e612a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.436591 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5138a449-81c8-4a01-ac51-7fe77d4e612a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:04.436791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5138a449-81c8-4a01-ac51-7fe77d4e612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:04.459525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0659239-fbf0-477e-b47b-0cf9bd731e92 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:04.500255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caadff-4cfc-45ca-8819-cbea4381f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:04.501288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caadff-4cfc-45ca-8819-cbea4381f7fd None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.501797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caadff-4cfc-45ca-8819-cbea4381f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.502255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caadff-4cfc-45ca-8819-cbea4381f7fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.509321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 177/349] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:04.510184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138a449-81c8-4a01-ac51-7fe77d4e612a None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.586613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caadff-4cfc-45ca-8819-cbea4381f7fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:04.588550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caadff-4cfc-45ca-8819-cbea4381f7fd None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:04.592589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:04.594718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:04.618544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138a449-81c8-4a01-ac51-7fe77d4e612a None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:04.656846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e7a0-8042-4b1f-99d6-cf6e56ae22af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:04.657028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e7a0-8042-4b1f-99d6-cf6e56ae22af None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.657302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e7a0-8042-4b1f-99d6-cf6e56ae22af None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.657581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e7a0-8042-4b1f-99d6-cf6e56ae22af None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.664155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e7a0-8042-4b1f-99d6-cf6e56ae22af None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:04.665642 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e7a0-8042-4b1f-99d6-cf6e56ae22af None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:04.667445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 178/350] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:04.668898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e7a0-8042-4b1f-99d6-cf6e56ae22af None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.703628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 173/351] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:04.704869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caadff-4cfc-45ca-8819-cbea4381f7fd None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.785665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e7a0-8042-4b1f-99d6-cf6e56ae22af None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:04.828235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:04.834092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3375dc3-fe8f-4956-a221-98ca5663a04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:04.834852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caadff-4cfc-45ca-8819-cbea4381f7fd None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:04.835296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3375dc3-fe8f-4956-a221-98ca5663a04d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.835865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3375dc3-fe8f-4956-a221-98ca5663a04d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.836508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3375dc3-fe8f-4956-a221-98ca5663a04d None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.838286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3375dc3-fe8f-4956-a221-98ca5663a04d None admin] RBAC: Adding query filter params (name=member) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:04.839998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3375dc3-fe8f-4956-a221-98ca5663a04d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:04.841650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3375dc3-fe8f-4956-a221-98ca5663a04d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:04.855269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 179/352] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:04.856797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3375dc3-fe8f-4956-a221-98ca5663a04d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.860281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:04.875835 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda7f9d-24d6-42c2-8b07-96ad7accfc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:04.876778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda7f9d-24d6-42c2-8b07-96ad7accfc13 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.877067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda7f9d-24d6-42c2-8b07-96ad7accfc13 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.877344 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda7f9d-24d6-42c2-8b07-96ad7accfc13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.889252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda7f9d-24d6-42c2-8b07-96ad7accfc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-0fda7f9d-24d6-42c2-8b07-96ad7accfc13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:04.897188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:04.898072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:04.898888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 174/353] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:04.899524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda7f9d-24d6-42c2-8b07-96ad7accfc13 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.992404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3375dc3-fe8f-4956-a221-98ca5663a04d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:05.018730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda7f9d-24d6-42c2-8b07-96ad7accfc13 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:05.044648 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57d488-cd70-484b-9889-5a65944c3ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:05.045377 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57d488-cd70-484b-9889-5a65944c3ec4 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.045661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57d488-cd70-484b-9889-5a65944c3ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.045954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57d488-cd70-484b-9889-5a65944c3ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.046837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57d488-cd70-484b-9889-5a65944c3ec4 None admin] RBAC: Adding query filter params (group.id=e148bca31aa44115af4aa4f46a3eae74, role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:05.047160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57d488-cd70-484b-9889-5a65944c3ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:05.048838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57d488-cd70-484b-9889-5a65944c3ec4 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:05.055440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 180/354] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/role_assignments?group.id=e148bca31aa44115af4aa4f46a3eae74&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:05.056110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57d488-cd70-484b-9889-5a65944c3ec4 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:05.062521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849742a-da85-4245-b5b3-bb8ceb0381ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:05.063807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849742a-da85-4245-b5b3-bb8ceb0381ac None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.064305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849742a-da85-4245-b5b3-bb8ceb0381ac None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.064790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849742a-da85-4245-b5b3-bb8ceb0381ac None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.067156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849742a-da85-4245-b5b3-bb8ceb0381ac None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:05.069450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849742a-da85-4245-b5b3-bb8ceb0381ac None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:05.072317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 175/355] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:05.073562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849742a-da85-4245-b5b3-bb8ceb0381ac None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:05.116125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:05.162875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:05.217981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57d488-cd70-484b-9889-5a65944c3ec4 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:05.270827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7a95d-27a4-4b70-a8a1-fec766f032ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:05.271880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7a95d-27a4-4b70-a8a1-fec766f032ad None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.272389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7a95d-27a4-4b70-a8a1-fec766f032ad None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.273098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7a95d-27a4-4b70-a8a1-fec766f032ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.290114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849742a-da85-4245-b5b3-bb8ceb0381ac None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:05.335779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc2518-acc7-4bb3-bc2f-d8d91453d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:05.336820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc2518-acc7-4bb3-bc2f-d8d91453d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.337302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc2518-acc7-4bb3-bc2f-d8d91453d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.337786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc2518-acc7-4bb3-bc2f-d8d91453d4e7 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.338740 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc2518-acc7-4bb3-bc2f-d8d91453d4e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:05.339052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc2518-acc7-4bb3-bc2f-d8d91453d4e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:05.341170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc2518-acc7-4bb3-bc2f-d8d91453d4e7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:05.354778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 176/356] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:20:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:05.355768 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc2518-acc7-4bb3-bc2f-d8d91453d4e7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:05.359571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7a95d-27a4-4b70-a8a1-fec766f032ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:05.361298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7a95d-27a4-4b70-a8a1-fec766f032ad None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:05.447293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:05.473802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:05.495547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc2518-acc7-4bb3-bc2f-d8d91453d4e7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:05.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 181/357] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:05.499900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0d6c3-751c-4ceb-887a-aa8702bc8852 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.500537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0d6c3-751c-4ceb-887a-aa8702bc8852 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.501832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0d6c3-751c-4ceb-887a-aa8702bc8852 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.503665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 182/358] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:05.505763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0d6c3-751c-4ceb-887a-aa8702bc8852 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:05.546425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea799aa9-7dbe-42e1-9aab-2f344d145c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:05.547717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea799aa9-7dbe-42e1-9aab-2f344d145c7f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.548035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea799aa9-7dbe-42e1-9aab-2f344d145c7f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.548467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea799aa9-7dbe-42e1-9aab-2f344d145c7f None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.549649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea799aa9-7dbe-42e1-9aab-2f344d145c7f None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:05.551079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea799aa9-7dbe-42e1-9aab-2f344d145c7f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:05.559645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 177/359] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:05 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:05.559645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea799aa9-7dbe-42e1-9aab-2f344d145c7f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:05.651133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0d6c3-751c-4ceb-887a-aa8702bc8852 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:05.676554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea799aa9-7dbe-42e1-9aab-2f344d145c7f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:05.696221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0c93-60a5-42aa-aa2c-730d6d1e0f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:05.697450 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0c93-60a5-42aa-aa2c-730d6d1e0f9b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.697731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0c93-60a5-42aa-aa2c-730d6d1e0f9b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.698028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0c93-60a5-42aa-aa2c-730d6d1e0f9b None admin] PATH_INFO: `/v3/users/a76f1ef8ce614388a5197f2f1be8c2ae` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.699705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0c93-60a5-42aa-aa2c-730d6d1e0f9b None admin] RBAC: Authorizing `identity:get_user(user_id=a76f1ef8ce614388a5197f2f1be8c2ae)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:05.701714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0c93-60a5-42aa-aa2c-730d6d1e0f9b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:05.704034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 183/360] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:20:05 2022] GET /identity/v3/users/a76f1ef8ce614388a5197f2f1be8c2ae => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:05.708973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b5625-f397-4829-8697-440fcf3824a8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.709261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b5625-f397-4829-8697-440fcf3824a8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.709541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b5625-f397-4829-8697-440fcf3824a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.713425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de4c4d-75d8-492d-87af-df5dabd0e864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:05.714289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4c4d-75d8-492d-87af-df5dabd0e864 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.714572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4c4d-75d8-492d-87af-df5dabd0e864 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.714850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4c4d-75d8-492d-87af-df5dabd0e864 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.716064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de4c4d-75d8-492d-87af-df5dabd0e864 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:05.717563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de4c4d-75d8-492d-87af-df5dabd0e864 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:05.719560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 178/361] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:05 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:05.720805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fd032-cf8b-4e97-9724-b083e84b5bf9 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.721092 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fd032-cf8b-4e97-9724-b083e84b5bf9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.721366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fd032-cf8b-4e97-9724-b083e84b5bf9 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.722820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 179/362] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:05.723525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fd032-cf8b-4e97-9724-b083e84b5bf9 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:05.728917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ac4b5625-f397-4829-8697-440fcf3824a8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:05.730120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ac4b5625-f397-4829-8697-440fcf3824a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:05.758798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:05.764560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:05.815979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 184/363] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:05.816811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b5625-f397-4829-8697-440fcf3824a8 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:05.854801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fd032-cf8b-4e97-9724-b083e84b5bf9 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:05.901463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651d1ad-2e0e-4a6c-a2d1-35ef9b1cdb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:05.902144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651d1ad-2e0e-4a6c-a2d1-35ef9b1cdb11 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.902426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651d1ad-2e0e-4a6c-a2d1-35ef9b1cdb11 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.902699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651d1ad-2e0e-4a6c-a2d1-35ef9b1cdb11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.903526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651d1ad-2e0e-4a6c-a2d1-35ef9b1cdb11 None admin] RBAC: Adding query filter params (group.id=e148bca31aa44115af4aa4f46a3eae74, role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:05.904841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651d1ad-2e0e-4a6c-a2d1-35ef9b1cdb11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:05.907933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651d1ad-2e0e-4a6c-a2d1-35ef9b1cdb11 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:05.912934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 180/364] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:05 2022] GET /identity/v3/role_assignments?group.id=e148bca31aa44115af4aa4f46a3eae74&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:05.914194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66db1df-ccba-4bdb-8538-026882a4670d None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:05.914480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66db1df-ccba-4bdb-8538-026882a4670d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:05.914754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66db1df-ccba-4bdb-8538-026882a4670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:05.933506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-e66db1df-ccba-4bdb-8538-026882a4670d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:05.934724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e66db1df-ccba-4bdb-8538-026882a4670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:05.967780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b5625-f397-4829-8697-440fcf3824a8 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.013152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 181/365] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:06.013864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66db1df-ccba-4bdb-8538-026882a4670d None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:06.019225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd0d26-0adb-4337-9aa7-b347defd841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.019968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd0d26-0adb-4337-9aa7-b347defd841c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.020275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd0d26-0adb-4337-9aa7-b347defd841c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.020557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd0d26-0adb-4337-9aa7-b347defd841c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.021450 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd0d26-0adb-4337-9aa7-b347defd841c None admin] RBAC: Adding query filter params (role.id=e68a59a8cda94903b57e7f58718fd182, user.id=a76f1ef8ce614388a5197f2f1be8c2ae, scope.system=all) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:06.021765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd0d26-0adb-4337-9aa7-b347defd841c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:06.030833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd0d26-0adb-4337-9aa7-b347defd841c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:06.036207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:06.051532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 185/366] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jun 16 00:20:05 2022] GET /identity/v3/role_assignments?user.id=a76f1ef8ce614388a5197f2f1be8c2ae&scope.system=all&role.id=e68a59a8cda94903b57e7f58718fd182 => generated 510 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:06.052459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd0d26-0adb-4337-9aa7-b347defd841c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:06.092652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:06.137585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66db1df-ccba-4bdb-8538-026882a4670d None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.177008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40e94c-6a4a-4deb-a07a-cd72f484a6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.177698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd0d26-0adb-4337-9aa7-b347defd841c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.178939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e94c-6a4a-4deb-a07a-cd72f484a6a2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.179450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e94c-6a4a-4deb-a07a-cd72f484a6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.180015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e94c-6a4a-4deb-a07a-cd72f484a6a2 None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.181826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40e94c-6a4a-4deb-a07a-cd72f484a6a2 None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:06.183555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40e94c-6a4a-4deb-a07a-cd72f484a6a2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:06.185579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 182/367] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:06 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:06.186681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40e94c-6a4a-4deb-a07a-cd72f484a6a2 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:06.215552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5732a-74b2-4fc3-95d7-47758f131720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.216491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5732a-74b2-4fc3-95d7-47758f131720 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.216695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5732a-74b2-4fc3-95d7-47758f131720 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.217506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5732a-74b2-4fc3-95d7-47758f131720 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.229954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5732a-74b2-4fc3-95d7-47758f131720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-19a5732a-74b2-4fc3-95d7-47758f131720 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:06.239157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:06.240202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:06.240989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 186/368] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:20:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:06.242242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5732a-74b2-4fc3-95d7-47758f131720 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:06.304833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:06.328120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40e94c-6a4a-4deb-a07a-cd72f484a6a2 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.362714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:06.378755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594995bc-000f-4390-9318-1e9dfb0e8e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.378961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594995bc-000f-4390-9318-1e9dfb0e8e95 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.379218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594995bc-000f-4390-9318-1e9dfb0e8e95 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.379473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594995bc-000f-4390-9318-1e9dfb0e8e95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.391706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5732a-74b2-4fc3-95d7-47758f131720 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.394638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594995bc-000f-4390-9318-1e9dfb0e8e95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-594995bc-000f-4390-9318-1e9dfb0e8e95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:06.406593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:06.407505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:06.408329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 183/369] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:06.408968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594995bc-000f-4390-9318-1e9dfb0e8e95 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:06.453993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4230b3-935f-450b-a0cf-e0430006f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.455111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4230b3-935f-450b-a0cf-e0430006f8ba None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.455680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4230b3-935f-450b-a0cf-e0430006f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.456200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4230b3-935f-450b-a0cf-e0430006f8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.457345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4230b3-935f-450b-a0cf-e0430006f8ba None admin] RBAC: Adding query filter params (group.id=e148bca31aa44115af4aa4f46a3eae74, role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=de248ef10d024a0087f98dbd00a26a29) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:06.457912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4230b3-935f-450b-a0cf-e0430006f8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:06.460188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4230b3-935f-450b-a0cf-e0430006f8ba None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:06.467766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 187/370] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:06 2022] GET /identity/v3/role_assignments?group.id=e148bca31aa44115af4aa4f46a3eae74&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:06.469176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4230b3-935f-450b-a0cf-e0430006f8ba None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:06.542919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594995bc-000f-4390-9318-1e9dfb0e8e95 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.599272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7637cd5-ac9f-4bd6-ba38-4e5fd07aaf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.599999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7637cd5-ac9f-4bd6-ba38-4e5fd07aaf37 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.600288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7637cd5-ac9f-4bd6-ba38-4e5fd07aaf37 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.600570 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7637cd5-ac9f-4bd6-ba38-4e5fd07aaf37 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.601333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7637cd5-ac9f-4bd6-ba38-4e5fd07aaf37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:06.601647 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7637cd5-ac9f-4bd6-ba38-4e5fd07aaf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:06.603944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7637cd5-ac9f-4bd6-ba38-4e5fd07aaf37 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:06.616652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 184/371] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:06.618865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4230b3-935f-450b-a0cf-e0430006f8ba None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.623556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7637cd5-ac9f-4bd6-ba38-4e5fd07aaf37 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:06.636941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:06.664395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb1621-9f33-4eb7-83f1-43073a32be15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.665512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb1621-9f33-4eb7-83f1-43073a32be15 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.665991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb1621-9f33-4eb7-83f1-43073a32be15 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.666468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb1621-9f33-4eb7-83f1-43073a32be15 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.667432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb1621-9f33-4eb7-83f1-43073a32be15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:06.667967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb1621-9f33-4eb7-83f1-43073a32be15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:06.669742 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb1621-9f33-4eb7-83f1-43073a32be15 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:06.680368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 188/372] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:06.688838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb1621-9f33-4eb7-83f1-43073a32be15 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:06.707461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:06.760882 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7637cd5-ac9f-4bd6-ba38-4e5fd07aaf37 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.800695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc596e2-982d-4b53-a6ee-1d70066d4601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.801376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc596e2-982d-4b53-a6ee-1d70066d4601 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.801661 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc596e2-982d-4b53-a6ee-1d70066d4601 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.801938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc596e2-982d-4b53-a6ee-1d70066d4601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.813513 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb1621-9f33-4eb7-83f1-43073a32be15 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.857805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ac392-ba93-4400-b763-218e2aea0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.858608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ac392-ba93-4400-b763-218e2aea0084 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.858953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ac392-ba93-4400-b763-218e2aea0084 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.859245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ac392-ba93-4400-b763-218e2aea0084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.894486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc596e2-982d-4b53-a6ee-1d70066d4601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:06.896012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc596e2-982d-4b53-a6ee-1d70066d4601 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:06.906678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:06.946489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ac392-ba93-4400-b763-218e2aea0084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:06.950166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ac392-ba93-4400-b763-218e2aea0084 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:06.962889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:07.005478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 185/373] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:07.033186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc596e2-982d-4b53-a6ee-1d70066d4601 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:07.071296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 189/374] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:07.093232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ac392-ba93-4400-b763-218e2aea0084 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:07.170474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc596e2-982d-4b53-a6ee-1d70066d4601 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:07.177667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:07.236144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ac392-ba93-4400-b763-218e2aea0084 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:07.240705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c7d6-0511-4742-a3d3-6f40692e41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:07.241797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c7d6-0511-4742-a3d3-6f40692e41a0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:07.242223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c7d6-0511-4742-a3d3-6f40692e41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:07.242640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c7d6-0511-4742-a3d3-6f40692e41a0 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:07.244102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c7d6-0511-4742-a3d3-6f40692e41a0 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:07.245698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c7d6-0511-4742-a3d3-6f40692e41a0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:07.246713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:07.251599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 186/375] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:07 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:07.257440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c7d6-0511-4742-a3d3-6f40692e41a0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:07.282533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d262e-5929-4755-af92-4d0d8e05b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:07.283455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d262e-5929-4755-af92-4d0d8e05b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:07.283757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d262e-5929-4755-af92-4d0d8e05b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:07.284028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d262e-5929-4755-af92-4d0d8e05b9f7 None admin] PATH_INFO: `/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:07.285362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d262e-5929-4755-af92-4d0d8e05b9f7 None admin] RBAC: Authorizing `identity:get_project(project_id=d3ad4439044a4113a3a2bd5f12c4d6da)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:07.288025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d262e-5929-4755-af92-4d0d8e05b9f7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:07.289733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 190/376] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:07 2022] GET /identity/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:07.296930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d262e-5929-4755-af92-4d0d8e05b9f7 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:07.417683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d262e-5929-4755-af92-4d0d8e05b9f7 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:07.458860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baa752-6434-4eb3-9d5a-44ef4fea7252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:07.459646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baa752-6434-4eb3-9d5a-44ef4fea7252 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:07.459963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baa752-6434-4eb3-9d5a-44ef4fea7252 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:07.460242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baa752-6434-4eb3-9d5a-44ef4fea7252 None admin] PATH_INFO: `/v3/groups/26858142a1ee4f6092717e4fd2228704` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:07.470709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baa752-6434-4eb3-9d5a-44ef4fea7252 None admin] RBAC: Authorizing `identity:get_group(group_id=26858142a1ee4f6092717e4fd2228704)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:07.472166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baa752-6434-4eb3-9d5a-44ef4fea7252 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:07.474262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 191/377] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:07 2022] GET /identity/v3/groups/26858142a1ee4f6092717e4fd2228704 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:07.480761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baa752-6434-4eb3-9d5a-44ef4fea7252 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:07.509924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c7d6-0511-4742-a3d3-6f40692e41a0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:07.532213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:07.588125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209026a-08fb-4028-9454-7ed366d11b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:07.588995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209026a-08fb-4028-9454-7ed366d11b7d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:07.589276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209026a-08fb-4028-9454-7ed366d11b7d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:07.589606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209026a-08fb-4028-9454-7ed366d11b7d None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:07.590860 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209026a-08fb-4028-9454-7ed366d11b7d None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:07.592876 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209026a-08fb-4028-9454-7ed366d11b7d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:07.594825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 187/378] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:07 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:07.600211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209026a-08fb-4028-9454-7ed366d11b7d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:07.601821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baa752-6434-4eb3-9d5a-44ef4fea7252 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:07.643392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec6968-cc23-4917-952d-d9e435171951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:07.644419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec6968-cc23-4917-952d-d9e435171951 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:07.645321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec6968-cc23-4917-952d-d9e435171951 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:07.645931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec6968-cc23-4917-952d-d9e435171951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:07.646950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec6968-cc23-4917-952d-d9e435171951 None admin] RBAC: Adding query filter params (group.id=26858142a1ee4f6092717e4fd2228704, role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=d3ad4439044a4113a3a2bd5f12c4d6da) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:07.647581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec6968-cc23-4917-952d-d9e435171951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:07.649898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec6968-cc23-4917-952d-d9e435171951 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:07.660017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 192/379] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:07 2022] GET /identity/v3/role_assignments?group.id=26858142a1ee4f6092717e4fd2228704&scope.project.id=d3ad4439044a4113a3a2bd5f12c4d6da&role.id=635caa85d8524fb887206fd521defd3f => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:07.678194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:07.762918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209026a-08fb-4028-9454-7ed366d11b7d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:07.799664 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332fb4-f5ee-48ab-8e96-73275cea1df1 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:07.800300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332fb4-f5ee-48ab-8e96-73275cea1df1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:07.800795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332fb4-f5ee-48ab-8e96-73275cea1df1 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:07.804292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 193/380] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:07.805379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa02740-c566-4998-b2b7-f1e7608318a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:07.806036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02740-c566-4998-b2b7-f1e7608318a9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:07.806311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02740-c566-4998-b2b7-f1e7608318a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:07.806702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02740-c566-4998-b2b7-f1e7608318a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:07.807415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa02740-c566-4998-b2b7-f1e7608318a9 None admin] RBAC: Adding query filter params (group.id=e148bca31aa44115af4aa4f46a3eae74, role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=de248ef10d024a0087f98dbd00a26a29) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:07.807724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa02740-c566-4998-b2b7-f1e7608318a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:07.808504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026be3a-3b5f-4bea-8e0e-99249eb934b1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:07.808981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026be3a-3b5f-4bea-8e0e-99249eb934b1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:07.809198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa02740-c566-4998-b2b7-f1e7608318a9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:07.809656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026be3a-3b5f-4bea-8e0e-99249eb934b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:07.815212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 188/381] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:07 2022] GET /identity/v3/role_assignments?group.id=e148bca31aa44115af4aa4f46a3eae74&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:07.831297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5026be3a-3b5f-4bea-8e0e-99249eb934b1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:07.833772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5026be3a-3b5f-4bea-8e0e-99249eb934b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:07.917616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 194/382] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:07.941161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa02740-c566-4998-b2b7-f1e7608318a9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:08.080716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa02740-c566-4998-b2b7-f1e7608318a9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:08.095364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:08.128919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067c7e-9217-4f59-855b-59ee2dc2c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:08.129724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067c7e-9217-4f59-855b-59ee2dc2c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.130016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067c7e-9217-4f59-855b-59ee2dc2c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.130263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067c7e-9217-4f59-855b-59ee2dc2c0d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.147138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067c7e-9217-4f59-855b-59ee2dc2c0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-bb067c7e-9217-4f59-855b-59ee2dc2c0d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:08.158601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:08.159634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:08.160488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:08.161797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 189/383] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:08.167840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026be3a-3b5f-4bea-8e0e-99249eb934b1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:08.221501 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:08.307717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026be3a-3b5f-4bea-8e0e-99249eb934b1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:08.354162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec04cc9-d5ac-40e0-afff-f05c3327f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:08.354836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04cc9-d5ac-40e0-afff-f05c3327f575 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.355120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04cc9-d5ac-40e0-afff-f05c3327f575 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.355395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04cc9-d5ac-40e0-afff-f05c3327f575 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.356163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec04cc9-d5ac-40e0-afff-f05c3327f575 None admin] RBAC: Adding query filter params (name=member) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:08.356471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec04cc9-d5ac-40e0-afff-f05c3327f575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:08.357917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec04cc9-d5ac-40e0-afff-f05c3327f575 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:08.371461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 195/384] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:20:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:08.377257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067c7e-9217-4f59-855b-59ee2dc2c0d9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:08.530617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067c7e-9217-4f59-855b-59ee2dc2c0d9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:08.568781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cedd5-78ca-4105-ac7c-879caa8bec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:08.569650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cedd5-78ca-4105-ac7c-879caa8bec68 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.569931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cedd5-78ca-4105-ac7c-879caa8bec68 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.570203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cedd5-78ca-4105-ac7c-879caa8bec68 None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.576445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cedd5-78ca-4105-ac7c-879caa8bec68 None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:08.577904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cedd5-78ca-4105-ac7c-879caa8bec68 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:08.579551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 190/385] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:08 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:08.585242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec04cc9-d5ac-40e0-afff-f05c3327f575 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:08.688015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:08.694844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec04cc9-d5ac-40e0-afff-f05c3327f575 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:08.730788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbe468-10cb-48a9-a848-64af0ea4aa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:08.732171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe468-10cb-48a9-a848-64af0ea4aa60 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.733175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe468-10cb-48a9-a848-64af0ea4aa60 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.733691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe468-10cb-48a9-a848-64af0ea4aa60 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.735167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe468-10cb-48a9-a848-64af0ea4aa60 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:08.736940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe468-10cb-48a9-a848-64af0ea4aa60 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:08.739228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 196/386] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:08 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:08.744608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cedd5-78ca-4105-ac7c-879caa8bec68 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:08.800843 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:08.886259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cedd5-78ca-4105-ac7c-879caa8bec68 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:08.935518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58ce02-fcd4-47d6-a21c-24f0a7a68629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:08.936495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58ce02-fcd4-47d6-a21c-24f0a7a68629 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.936784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58ce02-fcd4-47d6-a21c-24f0a7a68629 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.937063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58ce02-fcd4-47d6-a21c-24f0a7a68629 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/groups/e148bca31aa44115af4aa4f46a3eae74/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.939054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58ce02-fcd4-47d6-a21c-24f0a7a68629 None admin] RBAC: Authorizing `identity:create_grant(project_id=6999191d4ebb497fbaa576c8e3c1b945, group_id=e148bca31aa44115af4aa4f46a3eae74, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:08.940518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58ce02-fcd4-47d6-a21c-24f0a7a68629 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:09.047829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 191/387] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 16 00:20:08 2022] PUT /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/groups/e148bca31aa44115af4aa4f46a3eae74/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:09.310836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571078c-19d6-429f-8517-f3eba01c6654 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:09.311342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571078c-19d6-429f-8517-f3eba01c6654 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:09.311342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571078c-19d6-429f-8517-f3eba01c6654 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:09.313083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 197/388] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:09.319970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e900b-c81e-4245-ba9a-5a512433ee72 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:09.320264 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e900b-c81e-4245-ba9a-5a512433ee72 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:09.320545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e900b-c81e-4245-ba9a-5a512433ee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:09.340217 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-2d7e900b-c81e-4245-ba9a-5a512433ee72 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:09.341444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-2d7e900b-c81e-4245-ba9a-5a512433ee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:09.421028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 192/389] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:09.444808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571078c-19d6-429f-8517-f3eba01c6654 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:09.478198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f00d65-d84e-4f0a-a333-563b235d0bdd None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:09.478497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f00d65-d84e-4f0a-a333-563b235d0bdd None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:09.478759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f00d65-d84e-4f0a-a333-563b235d0bdd None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:09.480173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 193/390] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:09.485364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7839e61-c288-4d4e-9cd0-e26f878416e4 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:09.485666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7839e61-c288-4d4e-9cd0-e26f878416e4 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:09.485933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7839e61-c288-4d4e-9cd0-e26f878416e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:09.503775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f7839e61-c288-4d4e-9cd0-e26f878416e4 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:09.504661 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f7839e61-c288-4d4e-9cd0-e26f878416e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:09.533578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:09.611574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571078c-19d6-429f-8517-f3eba01c6654 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:09.623364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 194/391] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:20:09.646636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7839e61-c288-4d4e-9cd0-e26f878416e4 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:09.673075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef33ea3-afa9-45d9-a9a2-f379787e6dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:09.673900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef33ea3-afa9-45d9-a9a2-f379787e6dad None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:09.674183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef33ea3-afa9-45d9-a9a2-f379787e6dad None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:09.674463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef33ea3-afa9-45d9-a9a2-f379787e6dad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:09.689481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef33ea3-afa9-45d9-a9a2-f379787e6dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-aef33ea3-afa9-45d9-a9a2-f379787e6dad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:09.698536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:09.699462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:09.700297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:09.701974 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 198/392] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:20:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:09.707222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef33ea3-afa9-45d9-a9a2-f379787e6dad None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:09.757459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:09.799061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7839e61-c288-4d4e-9cd0-e26f878416e4 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:09.867776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8beb9a3-6a5b-457c-aafb-76731381abe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:09.868529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8beb9a3-6a5b-457c-aafb-76731381abe0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:09.868817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8beb9a3-6a5b-457c-aafb-76731381abe0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:09.869099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8beb9a3-6a5b-457c-aafb-76731381abe0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:09.884722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef33ea3-afa9-45d9-a9a2-f379787e6dad None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:09.896623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8beb9a3-6a5b-457c-aafb-76731381abe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-a8beb9a3-6a5b-457c-aafb-76731381abe0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:09.908489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:09.909395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:09.910166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 195/393] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:09.915804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8beb9a3-6a5b-457c-aafb-76731381abe0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:09.937147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48812223-f959-4f76-93d9-ced7b8fff759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:09.938556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48812223-f959-4f76-93d9-ced7b8fff759 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:09.939008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48812223-f959-4f76-93d9-ced7b8fff759 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:09.939472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48812223-f959-4f76-93d9-ced7b8fff759 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:09.940688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48812223-f959-4f76-93d9-ced7b8fff759 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:09.941150 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48812223-f959-4f76-93d9-ced7b8fff759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:09.942796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48812223-f959-4f76-93d9-ced7b8fff759 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:09.956959 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 199/394] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:09.961861 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:09.963152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48812223-f959-4f76-93d9-ced7b8fff759 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:10.105195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:10.134119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8beb9a3-6a5b-457c-aafb-76731381abe0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:10.136191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48812223-f959-4f76-93d9-ced7b8fff759 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:10.202356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990322-91e3-4f96-832d-cf45673b316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:10.203233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff24ab8-d258-48b0-9031-8317d68f3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:10.204304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff24ab8-d258-48b0-9031-8317d68f3324 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.205109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990322-91e3-4f96-832d-cf45673b316c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.205554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990322-91e3-4f96-832d-cf45673b316c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.205982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff24ab8-d258-48b0-9031-8317d68f3324 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.206399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990322-91e3-4f96-832d-cf45673b316c None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.206883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff24ab8-d258-48b0-9031-8317d68f3324 None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.208434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6990322-91e3-4f96-832d-cf45673b316c None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:10.209212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff24ab8-d258-48b0-9031-8317d68f3324 None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:10.209683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6990322-91e3-4f96-832d-cf45673b316c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:10.211231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6990322-91e3-4f96-832d-cf45673b316c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:10.212832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff24ab8-d258-48b0-9031-8317d68f3324 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:10.216274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 200/395] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:09 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:10.225173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff24ab8-d258-48b0-9031-8317d68f3324 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:10.233223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 196/396] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:20:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:10.241774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990322-91e3-4f96-832d-cf45673b316c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:10.352344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff24ab8-d258-48b0-9031-8317d68f3324 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:10.404690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:10.418364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0f74b-3034-4512-86cf-cf4b264b19d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:10.419232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0f74b-3034-4512-86cf-cf4b264b19d4 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.419518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0f74b-3034-4512-86cf-cf4b264b19d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.420351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0f74b-3034-4512-86cf-cf4b264b19d4 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.425731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0f74b-3034-4512-86cf-cf4b264b19d4 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:10.427217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0f74b-3034-4512-86cf-cf4b264b19d4 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:10.436926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 201/397] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:10 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:10.445482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0f74b-3034-4512-86cf-cf4b264b19d4 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:10.457253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990322-91e3-4f96-832d-cf45673b316c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:10.498516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:10.539122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f827e2-0c59-4261-817b-e110d69d0c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:10.540043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f827e2-0c59-4261-817b-e110d69d0c6b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.540330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f827e2-0c59-4261-817b-e110d69d0c6b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.540610 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f827e2-0c59-4261-817b-e110d69d0c6b None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.543889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f827e2-0c59-4261-817b-e110d69d0c6b None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:10.545969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f827e2-0c59-4261-817b-e110d69d0c6b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:10.548032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 197/398] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:10 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:10.557818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f827e2-0c59-4261-817b-e110d69d0c6b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:10.620556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0f74b-3034-4512-86cf-cf4b264b19d4 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:10.664312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2aff8-de48-4d2c-9202-fb660e39637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:10.665087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2aff8-de48-4d2c-9202-fb660e39637e None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.665369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2aff8-de48-4d2c-9202-fb660e39637e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.665641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2aff8-de48-4d2c-9202-fb660e39637e None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/groups/e148bca31aa44115af4aa4f46a3eae74/roles/19d43474add64d77beb4f1d8b56a2740` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.668211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2aff8-de48-4d2c-9202-fb660e39637e None admin] RBAC: Authorizing `identity:create_grant(project_id=6999191d4ebb497fbaa576c8e3c1b945, group_id=e148bca31aa44115af4aa4f46a3eae74, role_id=19d43474add64d77beb4f1d8b56a2740)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:10.669821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2aff8-de48-4d2c-9202-fb660e39637e None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:10.676006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f827e2-0c59-4261-817b-e110d69d0c6b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:10.708636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac88bc3-9cda-42c5-b530-788fc5a04719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:10.709491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac88bc3-9cda-42c5-b530-788fc5a04719 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.709778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac88bc3-9cda-42c5-b530-788fc5a04719 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.710054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac88bc3-9cda-42c5-b530-788fc5a04719 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.711236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac88bc3-9cda-42c5-b530-788fc5a04719 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:10.712745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac88bc3-9cda-42c5-b530-788fc5a04719 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:10.714425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 198/399] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:10 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:10.715590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ada7c7-6b75-4678-b6c9-53f080aa9445 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.715909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ada7c7-6b75-4678-b6c9-53f080aa9445 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.716187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ada7c7-6b75-4678-b6c9-53f080aa9445 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.718109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 199/400] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:10.719084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff1da1-f31b-4ae1-a440-82b8773b620f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.719374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff1da1-f31b-4ae1-a440-82b8773b620f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.719799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff1da1-f31b-4ae1-a440-82b8773b620f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.723949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 200/401] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:10.723949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff1da1-f31b-4ae1-a440-82b8773b620f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:10.738001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 202/402] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 16 00:20:10 2022] PUT /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945/groups/e148bca31aa44115af4aa4f46a3eae74/roles/19d43474add64d77beb4f1d8b56a2740 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:20:10.738329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:10.739418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60370c94-4195-41a6-bcf5-598d0b8e947f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.739711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60370c94-4195-41a6-bcf5-598d0b8e947f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.740058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60370c94-4195-41a6-bcf5-598d0b8e947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.761852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-60370c94-4195-41a6-bcf5-598d0b8e947f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:10.763251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-60370c94-4195-41a6-bcf5-598d0b8e947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:10.867810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 203/403] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:10.867810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e367b72-11ae-4619-a95f-28a0228b82ee None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.867810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e367b72-11ae-4619-a95f-28a0228b82ee None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.867810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e367b72-11ae-4619-a95f-28a0228b82ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.885457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff1da1-f31b-4ae1-a440-82b8773b620f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:10.897835 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-2e367b72-11ae-4619-a95f-28a0228b82ee None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:10.899083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2e367b72-11ae-4619-a95f-28a0228b82ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:10.909256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:10.930338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072364f6-dbcf-46a1-9041-0c99911c0fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:10.931144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072364f6-dbcf-46a1-9041-0c99911c0fc5 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:10.931423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072364f6-dbcf-46a1-9041-0c99911c0fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:10.931948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072364f6-dbcf-46a1-9041-0c99911c0fc5 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29/groups/e148bca31aa44115af4aa4f46a3eae74/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:10.934624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072364f6-dbcf-46a1-9041-0c99911c0fc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=de248ef10d024a0087f98dbd00a26a29, group_id=e148bca31aa44115af4aa4f46a3eae74, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:10.935927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072364f6-dbcf-46a1-9041-0c99911c0fc5 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:10.980996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 204/404] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:10.981893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e367b72-11ae-4619-a95f-28a0228b82ee None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:10.990505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 201/405] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 16 00:20:10 2022] PUT /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29/groups/e148bca31aa44115af4aa4f46a3eae74/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:11.005692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072364f6-dbcf-46a1-9041-0c99911c0fc5 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:11.107065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:11.142892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072364f6-dbcf-46a1-9041-0c99911c0fc5 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:11.191785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e367b72-11ae-4619-a95f-28a0228b82ee None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:11.191983 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8590-7cf0-4744-8ce7-2a3179a49b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:11.192704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8590-7cf0-4744-8ce7-2a3179a49b05 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.192991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8590-7cf0-4744-8ce7-2a3179a49b05 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.193463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8590-7cf0-4744-8ce7-2a3179a49b05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.207359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f8590-7cf0-4744-8ce7-2a3179a49b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-d65f8590-7cf0-4744-8ce7-2a3179a49b05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:11.218036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:11.218939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:11.219789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:11.220403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 202/406] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:20:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:11.226548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8590-7cf0-4744-8ce7-2a3179a49b05 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:11.239137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039babf8-7cad-4454-8c33-9b3d6855de70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:11.239990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039babf8-7cad-4454-8c33-9b3d6855de70 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.240274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039babf8-7cad-4454-8c33-9b3d6855de70 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.240554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039babf8-7cad-4454-8c33-9b3d6855de70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.256176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039babf8-7cad-4454-8c33-9b3d6855de70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-039babf8-7cad-4454-8c33-9b3d6855de70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:11.266838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:11.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:11.268977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 205/407] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:11.281000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039babf8-7cad-4454-8c33-9b3d6855de70 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:11.287561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:11.391393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8590-7cf0-4744-8ce7-2a3179a49b05 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:11.421150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:11.426846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090c905-e4b4-4add-b1d3-abd47607eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:11.427529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c905-e4b4-4add-b1d3-abd47607eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.427844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c905-e4b4-4add-b1d3-abd47607eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.428121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c905-e4b4-4add-b1d3-abd47607eaa1 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.428936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090c905-e4b4-4add-b1d3-abd47607eaa1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:11.429250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090c905-e4b4-4add-b1d3-abd47607eaa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:11.430628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090c905-e4b4-4add-b1d3-abd47607eaa1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:11.441973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 203/408] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:11.447415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090c905-e4b4-4add-b1d3-abd47607eaa1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:11.472545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039babf8-7cad-4454-8c33-9b3d6855de70 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:11.549486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cb1eb-8675-4e1d-8ab5-d25dd93decea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:11.550165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cb1eb-8675-4e1d-8ab5-d25dd93decea None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.550449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cb1eb-8675-4e1d-8ab5-d25dd93decea None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.550726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cb1eb-8675-4e1d-8ab5-d25dd93decea None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.552234 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cb1eb-8675-4e1d-8ab5-d25dd93decea None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:11.552553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cb1eb-8675-4e1d-8ab5-d25dd93decea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:11.553946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cb1eb-8675-4e1d-8ab5-d25dd93decea None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:11.578723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 206/409] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:11.588725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cb1eb-8675-4e1d-8ab5-d25dd93decea None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:11.621930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090c905-e4b4-4add-b1d3-abd47607eaa1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:11.658069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccddd2-b682-45c2-ac02-14bbd47eaad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:11.658965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccddd2-b682-45c2-ac02-14bbd47eaad9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.659302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccddd2-b682-45c2-ac02-14bbd47eaad9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.659584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccddd2-b682-45c2-ac02-14bbd47eaad9 None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.660809 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccddd2-b682-45c2-ac02-14bbd47eaad9 None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:11.662262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccddd2-b682-45c2-ac02-14bbd47eaad9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:11.664940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 204/410] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:11 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:11.670767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccddd2-b682-45c2-ac02-14bbd47eaad9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:11.740488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:11.788288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccddd2-b682-45c2-ac02-14bbd47eaad9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:11.797637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:11.860491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddc57f-fbbd-4313-b529-24d66ca02a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:11.861914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc57f-fbbd-4313-b529-24d66ca02a9f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.862329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc57f-fbbd-4313-b529-24d66ca02a9f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.862610 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc57f-fbbd-4313-b529-24d66ca02a9f None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.863871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc57f-fbbd-4313-b529-24d66ca02a9f None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:11.864237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cb1eb-8675-4e1d-8ab5-d25dd93decea None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:11.865334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc57f-fbbd-4313-b529-24d66ca02a9f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:11.868639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 205/411] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:11 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:11.869887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe33f23-67fa-45c3-91e0-2b8684cb3885 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.870174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe33f23-67fa-45c3-91e0-2b8684cb3885 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.870450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe33f23-67fa-45c3-91e0-2b8684cb3885 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.875827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 206/412] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:11.876698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe33f23-67fa-45c3-91e0-2b8684cb3885 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:11.910731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bd883-d7d6-4927-b5d5-3e1f43a2f01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:11.912364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd883-d7d6-4927-b5d5-3e1f43a2f01d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.912658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd883-d7d6-4927-b5d5-3e1f43a2f01d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.912940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd883-d7d6-4927-b5d5-3e1f43a2f01d None admin] PATH_INFO: `/v3/groups/26858142a1ee4f6092717e4fd2228704` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.914582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bd883-d7d6-4927-b5d5-3e1f43a2f01d None admin] RBAC: Authorizing `identity:get_group(group_id=26858142a1ee4f6092717e4fd2228704)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:11.916776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bd883-d7d6-4927-b5d5-3e1f43a2f01d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:11.918632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 207/413] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:11 2022] GET /identity/v3/groups/26858142a1ee4f6092717e4fd2228704 => generated 229 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:11.921226 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe8804-bb7b-44aa-a70c-a08002550008 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.921518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe8804-bb7b-44aa-a70c-a08002550008 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.921795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe8804-bb7b-44aa-a70c-a08002550008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.942275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-3dfe8804-bb7b-44aa-a70c-a08002550008 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:11.944114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3dfe8804-bb7b-44aa-a70c-a08002550008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:11.998458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe33f23-67fa-45c3-91e0-2b8684cb3885 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:12.035674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 208/414] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:12.040709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe8804-bb7b-44aa-a70c-a08002550008 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:12.041815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:12.066073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aebde8-babf-409c-b98b-980f44912d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:12.066969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aebde8-babf-409c-b98b-980f44912d5c None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:12.067253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aebde8-babf-409c-b98b-980f44912d5c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:12.067537 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aebde8-babf-409c-b98b-980f44912d5c None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29/groups/e148bca31aa44115af4aa4f46a3eae74/roles/19d43474add64d77beb4f1d8b56a2740` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:12.069846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aebde8-babf-409c-b98b-980f44912d5c None admin] RBAC: Authorizing `identity:create_grant(project_id=de248ef10d024a0087f98dbd00a26a29, group_id=e148bca31aa44115af4aa4f46a3eae74, role_id=19d43474add64d77beb4f1d8b56a2740)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:12.071302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aebde8-babf-409c-b98b-980f44912d5c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:12.115720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:12.147850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 207/415] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 16 00:20:11 2022] PUT /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29/groups/e148bca31aa44115af4aa4f46a3eae74/roles/19d43474add64d77beb4f1d8b56a2740 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:12.149229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aebde8-babf-409c-b98b-980f44912d5c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:12.182848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe8804-bb7b-44aa-a70c-a08002550008 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:12.272842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aebde8-babf-409c-b98b-980f44912d5c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:12.292504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716be384-4702-47a4-bd3e-11687e3674ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:12.293630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be384-4702-47a4-bd3e-11687e3674ec None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:12.293630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be384-4702-47a4-bd3e-11687e3674ec None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:12.293925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be384-4702-47a4-bd3e-11687e3674ec None admin] PATH_INFO: `/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:12.300697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716be384-4702-47a4-bd3e-11687e3674ec None admin] RBAC: Authorizing `identity:get_project(project_id=d3ad4439044a4113a3a2bd5f12c4d6da)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:12.302348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716be384-4702-47a4-bd3e-11687e3674ec None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:12.304410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 209/416] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:12 2022] GET /identity/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:12.312061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716be384-4702-47a4-bd3e-11687e3674ec None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:12.315406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ce5d4-2bcc-462d-b52c-e65ae542aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:12.316601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ce5d4-2bcc-462d-b52c-e65ae542aabb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:12.317168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ce5d4-2bcc-462d-b52c-e65ae542aabb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:12.317736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ce5d4-2bcc-462d-b52c-e65ae542aabb None admin] PATH_INFO: `/v3/roles/member` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:12.336104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ce5d4-2bcc-462d-b52c-e65ae542aabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-ab4ce5d4-2bcc-462d-b52c-e65ae542aabb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:12.346834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:12.347681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:12.348487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:12.349094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 208/417] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:12.355473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ce5d4-2bcc-462d-b52c-e65ae542aabb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:12.421118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:12.446377 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716be384-4702-47a4-bd3e-11687e3674ec None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:12.486666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:12.489749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ed5c-e80e-4ed8-8c70-df24123c88b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:12.490635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ed5c-e80e-4ed8-8c70-df24123c88b2 None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:12.490915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ed5c-e80e-4ed8-8c70-df24123c88b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:12.491193 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ed5c-e80e-4ed8-8c70-df24123c88b2 None admin] PATH_INFO: `/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da/groups/26858142a1ee4f6092717e4fd2228704/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:12.497439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ce5d4-2bcc-462d-b52c-e65ae542aabb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:12.499635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7ed5c-e80e-4ed8-8c70-df24123c88b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3ad4439044a4113a3a2bd5f12c4d6da, group_id=26858142a1ee4f6092717e4fd2228704, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:12.501131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7ed5c-e80e-4ed8-8c70-df24123c88b2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:12.543832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca38a70-2df4-4654-896f-bec1f3dfdbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:12.544433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca38a70-2df4-4654-896f-bec1f3dfdbbd None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:12.544741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca38a70-2df4-4654-896f-bec1f3dfdbbd None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:12.545022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca38a70-2df4-4654-896f-bec1f3dfdbbd None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:12.545766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca38a70-2df4-4654-896f-bec1f3dfdbbd None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:12.546071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca38a70-2df4-4654-896f-bec1f3dfdbbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:12.547797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca38a70-2df4-4654-896f-bec1f3dfdbbd None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:12.557791 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 209/418] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:20:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:12.562679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca38a70-2df4-4654-896f-bec1f3dfdbbd None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:12.627410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 210/419] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 16 00:20:12 2022] PUT /identity/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da/groups/26858142a1ee4f6092717e4fd2228704/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:12.676877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca38a70-2df4-4654-896f-bec1f3dfdbbd None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:12.692161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:12.714598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f9b9-debc-47ef-86cd-554db129583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:12.715276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f9b9-debc-47ef-86cd-554db129583d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:12.715567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f9b9-debc-47ef-86cd-554db129583d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:12.715887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f9b9-debc-47ef-86cd-554db129583d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:12.792700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8f9b9-debc-47ef-86cd-554db129583d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:12.794324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8f9b9-debc-47ef-86cd-554db129583d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:12.901906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 210/420] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:12.907537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ed5c-e80e-4ed8-8c70-df24123c88b2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:13.040608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ed5c-e80e-4ed8-8c70-df24123c88b2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:13.096476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fc62a-e555-411f-a955-e309b10bfea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:13.097367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc62a-e555-411f-a955-e309b10bfea5 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.097652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc62a-e555-411f-a955-e309b10bfea5 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.097930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc62a-e555-411f-a955-e309b10bfea5 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.099187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fc62a-e555-411f-a955-e309b10bfea5 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:13.100684 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fc62a-e555-411f-a955-e309b10bfea5 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:13.102690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 211/421] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:12 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:13.108871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f9b9-debc-47ef-86cd-554db129583d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:13.124881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:13.191553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d163f98-501b-4580-8804-9687a8ac1dff None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.191905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d163f98-501b-4580-8804-9687a8ac1dff None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.192140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d163f98-501b-4580-8804-9687a8ac1dff None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.193687 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 212/422] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:13.199076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864ebed-2c6a-4b74-bbbf-77f8033fa872 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.199655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864ebed-2c6a-4b74-bbbf-77f8033fa872 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.200159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864ebed-2c6a-4b74-bbbf-77f8033fa872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.217997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-b864ebed-2c6a-4b74-bbbf-77f8033fa872 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:13.219499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b864ebed-2c6a-4b74-bbbf-77f8033fa872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:13.267602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f9b9-debc-47ef-86cd-554db129583d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:13.277882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:13.299842 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 213/423] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:20:13.319101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864ebed-2c6a-4b74-bbbf-77f8033fa872 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:13.334110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f1ac2-7d5e-4bf0-9326-72ce006ba2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:13.335431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f1ac2-7d5e-4bf0-9326-72ce006ba2ee None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.335725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f1ac2-7d5e-4bf0-9326-72ce006ba2ee None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.336029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f1ac2-7d5e-4bf0-9326-72ce006ba2ee None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.337538 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f1ac2-7d5e-4bf0-9326-72ce006ba2ee None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:13.339551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f1ac2-7d5e-4bf0-9326-72ce006ba2ee None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:13.341638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 211/424] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:13 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:13.350107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f1ac2-7d5e-4bf0-9326-72ce006ba2ee None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:13.434405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864ebed-2c6a-4b74-bbbf-77f8033fa872 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:13.469613 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286dcee-4b03-47f3-91fe-d279f643d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:13.470535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286dcee-4b03-47f3-91fe-d279f643d984 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.470819 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286dcee-4b03-47f3-91fe-d279f643d984 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.471135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286dcee-4b03-47f3-91fe-d279f643d984 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.481755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286dcee-4b03-47f3-91fe-d279f643d984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-5286dcee-4b03-47f3-91fe-d279f643d984 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:13.490876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:13.492242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:13.493295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 214/425] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:20:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:13.504383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:13.505666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286dcee-4b03-47f3-91fe-d279f643d984 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:13.542048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f1ac2-7d5e-4bf0-9326-72ce006ba2ee None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:13.597540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310354a-b8d2-4450-9463-97bdb0d472b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:13.598207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310354a-b8d2-4450-9463-97bdb0d472b8 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.598491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310354a-b8d2-4450-9463-97bdb0d472b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.598770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310354a-b8d2-4450-9463-97bdb0d472b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.599621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310354a-b8d2-4450-9463-97bdb0d472b8 None admin] RBAC: Adding query filter params (group.id=e148bca31aa44115af4aa4f46a3eae74, role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:13.599944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310354a-b8d2-4450-9463-97bdb0d472b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:13.601438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310354a-b8d2-4450-9463-97bdb0d472b8 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:13.607044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:13.608484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 212/426] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:13 2022] GET /identity/v3/role_assignments?group.id=e148bca31aa44115af4aa4f46a3eae74&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 611 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:13.609569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca8d7-fa5f-4300-ac51-3d285880aa3c None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.610053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca8d7-fa5f-4300-ac51-3d285880aa3c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.610156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca8d7-fa5f-4300-ac51-3d285880aa3c None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.615351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 213/427] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:13.625277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dc8ea-12e9-42fd-a901-72c20d29c9f4 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.625588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dc8ea-12e9-42fd-a901-72c20d29c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.625841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dc8ea-12e9-42fd-a901-72c20d29c9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.667802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-814dc8ea-12e9-42fd-a901-72c20d29c9f4 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:13.668971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-814dc8ea-12e9-42fd-a901-72c20d29c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:13.677356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286dcee-4b03-47f3-91fe-d279f643d984 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:13.724141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b9e7b-1709-4372-bd9e-a6f8d0210b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:13.725223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b9e7b-1709-4372-bd9e-a6f8d0210b00 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.725726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b9e7b-1709-4372-bd9e-a6f8d0210b00 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.726217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b9e7b-1709-4372-bd9e-a6f8d0210b00 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.727167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b9e7b-1709-4372-bd9e-a6f8d0210b00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:13.729099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b9e7b-1709-4372-bd9e-a6f8d0210b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:13.733319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b9e7b-1709-4372-bd9e-a6f8d0210b00 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:13.750559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 215/428] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:13.764811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b9e7b-1709-4372-bd9e-a6f8d0210b00 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:13.852594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 214/429] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:13.879763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dc8ea-12e9-42fd-a901-72c20d29c9f4 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:13.890106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b9e7b-1709-4372-bd9e-a6f8d0210b00 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:13.903459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:13.943567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fe288-3c47-4ead-b8c3-1104017fe391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:13.944246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe288-3c47-4ead-b8c3-1104017fe391 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.944528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe288-3c47-4ead-b8c3-1104017fe391 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.944800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe288-3c47-4ead-b8c3-1104017fe391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.973602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:14.003478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dc8ea-12e9-42fd-a901-72c20d29c9f4 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:14.043194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fe288-3c47-4ead-b8c3-1104017fe391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:14.045356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fe288-3c47-4ead-b8c3-1104017fe391 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:14.047107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977edeea-dfce-4ca5-8bbd-319e58ab0c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:14.048115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977edeea-dfce-4ca5-8bbd-319e58ab0c5f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:14.048496 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977edeea-dfce-4ca5-8bbd-319e58ab0c5f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:14.048866 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977edeea-dfce-4ca5-8bbd-319e58ab0c5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:14.063862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977edeea-dfce-4ca5-8bbd-319e58ab0c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-977edeea-dfce-4ca5-8bbd-319e58ab0c5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:14.072742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:14.073928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:20:14.074912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:14.079889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 215/430] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:14.088058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977edeea-dfce-4ca5-8bbd-319e58ab0c5f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:14.183395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 216/431] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:14.189671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fe288-3c47-4ead-b8c3-1104017fe391 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:14.206307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977edeea-dfce-4ca5-8bbd-319e58ab0c5f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:14.209371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:14.241032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224175d3-75c3-4afa-9ca2-550377ddb215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:14.241708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224175d3-75c3-4afa-9ca2-550377ddb215 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:14.241993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224175d3-75c3-4afa-9ca2-550377ddb215 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:14.242274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224175d3-75c3-4afa-9ca2-550377ddb215 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:14.243021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224175d3-75c3-4afa-9ca2-550377ddb215 None admin] RBAC: Adding query filter params (name=member) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:14.243451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224175d3-75c3-4afa-9ca2-550377ddb215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:14.244987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224175d3-75c3-4afa-9ca2-550377ddb215 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:14.256128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:14.257357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 216/432] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:20:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:14.260452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224175d3-75c3-4afa-9ca2-550377ddb215 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:14.312416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fe288-3c47-4ead-b8c3-1104017fe391 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:14.351858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcedd3a-158b-4eb3-a052-12ad38d35e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:14.352721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcedd3a-158b-4eb3-a052-12ad38d35e83 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:14.353004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcedd3a-158b-4eb3-a052-12ad38d35e83 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:14.353281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcedd3a-158b-4eb3-a052-12ad38d35e83 None admin] PATH_INFO: `/v3/projects/6999191d4ebb497fbaa576c8e3c1b945` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:14.354474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcedd3a-158b-4eb3-a052-12ad38d35e83 None admin] RBAC: Authorizing `identity:get_project(project_id=6999191d4ebb497fbaa576c8e3c1b945)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:14.355987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcedd3a-158b-4eb3-a052-12ad38d35e83 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:14.358048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 217/433] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:14 2022] GET /identity/v3/projects/6999191d4ebb497fbaa576c8e3c1b945 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:14.363890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcedd3a-158b-4eb3-a052-12ad38d35e83 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:14.374982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224175d3-75c3-4afa-9ca2-550377ddb215 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:14.427037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b644816-6a67-4de9-ae66-4d2f1fc6d4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:14.427690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b644816-6a67-4de9-ae66-4d2f1fc6d4bd None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:14.428277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b644816-6a67-4de9-ae66-4d2f1fc6d4bd None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:14.428557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b644816-6a67-4de9-ae66-4d2f1fc6d4bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:14.461639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:14.487622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcedd3a-158b-4eb3-a052-12ad38d35e83 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:14.519704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b644816-6a67-4de9-ae66-4d2f1fc6d4bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:14.521650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b644816-6a67-4de9-ae66-4d2f1fc6d4bd None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:14.523912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:14.538166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c633d-c3b9-4aca-b85c-76f1ac8724a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:14.540048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c633d-c3b9-4aca-b85c-76f1ac8724a8 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:14.540945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c633d-c3b9-4aca-b85c-76f1ac8724a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:14.541663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c633d-c3b9-4aca-b85c-76f1ac8724a8 None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:14.543263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c633d-c3b9-4aca-b85c-76f1ac8724a8 None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:14.545853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c633d-c3b9-4aca-b85c-76f1ac8724a8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:14.548750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 218/434] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:14 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:14.554078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c633d-c3b9-4aca-b85c-76f1ac8724a8 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:14.650865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 217/435] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:14.668583 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b644816-6a67-4de9-ae66-4d2f1fc6d4bd None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:14.673721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c633d-c3b9-4aca-b85c-76f1ac8724a8 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:14.709514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d88e61-d91d-46a7-a8d7-b208e7f20d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:14.710731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d88e61-d91d-46a7-a8d7-b208e7f20d60 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:14.711242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d88e61-d91d-46a7-a8d7-b208e7f20d60 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:14.711776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d88e61-d91d-46a7-a8d7-b208e7f20d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:14.712890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d88e61-d91d-46a7-a8d7-b208e7f20d60 None admin] RBAC: Adding query filter params (group.id=e148bca31aa44115af4aa4f46a3eae74, role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=6999191d4ebb497fbaa576c8e3c1b945) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:14.713207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d88e61-d91d-46a7-a8d7-b208e7f20d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:14.714785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d88e61-d91d-46a7-a8d7-b208e7f20d60 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:14.724194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 219/436] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:14 2022] GET /identity/v3/role_assignments?group.id=e148bca31aa44115af4aa4f46a3eae74&scope.project.id=6999191d4ebb497fbaa576c8e3c1b945&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:14.724194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c55e-f7f8-440d-9034-8818eef01c52 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:14.724194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c55e-f7f8-440d-9034-8818eef01c52 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:14.724194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c55e-f7f8-440d-9034-8818eef01c52 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:14.725120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 220/437] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:14.734209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c47ed-89da-4cce-8009-4d556f960cbb None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:14.734495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c47ed-89da-4cce-8009-4d556f960cbb None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:14.734768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c47ed-89da-4cce-8009-4d556f960cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:14.752822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-262c47ed-89da-4cce-8009-4d556f960cbb None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:14.754046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-262c47ed-89da-4cce-8009-4d556f960cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:14.765033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:14.778203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:14.786689 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b644816-6a67-4de9-ae66-4d2f1fc6d4bd None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:14.826417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56413f4-554e-42f5-96b0-f7afe1646b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:14.827403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56413f4-554e-42f5-96b0-f7afe1646b8f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:14.827766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56413f4-554e-42f5-96b0-f7afe1646b8f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:14.828068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56413f4-554e-42f5-96b0-f7afe1646b8f None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:14.829433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56413f4-554e-42f5-96b0-f7afe1646b8f None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:14.831082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56413f4-554e-42f5-96b0-f7afe1646b8f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:14.837895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 218/438] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:14 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:14.838857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56413f4-554e-42f5-96b0-f7afe1646b8f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:14.852160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 221/439] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:14.874036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c47ed-89da-4cce-8009-4d556f960cbb None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:14.959366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56413f4-554e-42f5-96b0-f7afe1646b8f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.004074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707df78-7264-45a8-a46f-6860f14c27fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.004789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707df78-7264-45a8-a46f-6860f14c27fa None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.005072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707df78-7264-45a8-a46f-6860f14c27fa None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.005348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707df78-7264-45a8-a46f-6860f14c27fa None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.006329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c47ed-89da-4cce-8009-4d556f960cbb None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.006794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707df78-7264-45a8-a46f-6860f14c27fa None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:15.008285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707df78-7264-45a8-a46f-6860f14c27fa None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:15.010110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 219/440] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:14 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:15.016644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707df78-7264-45a8-a46f-6860f14c27fa None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:15.049867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c70028-3e44-46ee-b676-61473eb16747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.050948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c70028-3e44-46ee-b676-61473eb16747 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.051225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c70028-3e44-46ee-b676-61473eb16747 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.051649 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c70028-3e44-46ee-b676-61473eb16747 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.052553 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:15.062030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:15.065888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c70028-3e44-46ee-b676-61473eb16747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-d3c70028-3e44-46ee-b676-61473eb16747 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:15.076960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:15.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:15.078728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:15.079325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 222/441] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:20:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:15.084567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c70028-3e44-46ee-b676-61473eb16747 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:15.135612 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707df78-7264-45a8-a46f-6860f14c27fa None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.186659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcc58d-a609-4e00-a220-a5a79d64b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.187376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcc58d-a609-4e00-a220-a5a79d64b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.187663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcc58d-a609-4e00-a220-a5a79d64b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.188050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcc58d-a609-4e00-a220-a5a79d64b5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.188903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcc58d-a609-4e00-a220-a5a79d64b5f6 None admin] RBAC: Adding query filter params (group.id=e148bca31aa44115af4aa4f46a3eae74, role.id=83fe8b5fb84b42b298cd6be18a2d0759, scope.project.id=de248ef10d024a0087f98dbd00a26a29) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:15.189213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcc58d-a609-4e00-a220-a5a79d64b5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:15.190677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcc58d-a609-4e00-a220-a5a79d64b5f6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:15.200129 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 220/442] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:15 2022] GET /identity/v3/role_assignments?group.id=e148bca31aa44115af4aa4f46a3eae74&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=83fe8b5fb84b42b298cd6be18a2d0759 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:15.222625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c70028-3e44-46ee-b676-61473eb16747 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.225985 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecdaca-333c-4286-9986-d677d0fd8a64 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.226313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecdaca-333c-4286-9986-d677d0fd8a64 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.226522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecdaca-333c-4286-9986-d677d0fd8a64 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.228204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 221/443] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:15.234255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db87fc8-ebf6-4476-98ea-cdf7228b6a6b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.234580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db87fc8-ebf6-4476-98ea-cdf7228b6a6b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.234820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db87fc8-ebf6-4476-98ea-cdf7228b6a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.251635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0db87fc8-ebf6-4476-98ea-cdf7228b6a6b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:15.252883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0db87fc8-ebf6-4476-98ea-cdf7228b6a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:15.261008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4416e-6b29-4111-a8ed-64768dded065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.262262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4416e-6b29-4111-a8ed-64768dded065 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.262555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4416e-6b29-4111-a8ed-64768dded065 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.262835 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4416e-6b29-4111-a8ed-64768dded065 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.263660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4416e-6b29-4111-a8ed-64768dded065 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:15.264412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4416e-6b29-4111-a8ed-64768dded065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:15.266201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4416e-6b29-4111-a8ed-64768dded065 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:15.280317 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 223/444] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:15.282745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4416e-6b29-4111-a8ed-64768dded065 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:15.343085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 222/445] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:20:15.349982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:15.357678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db87fc8-ebf6-4476-98ea-cdf7228b6a6b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:15.391341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:15.397256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4416e-6b29-4111-a8ed-64768dded065 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.434963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fa9e2-e6d6-42f9-8f81-c87a8889322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.435966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fa9e2-e6d6-42f9-8f81-c87a8889322c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.436347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fa9e2-e6d6-42f9-8f81-c87a8889322c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.436527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fa9e2-e6d6-42f9-8f81-c87a8889322c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.482361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db87fc8-ebf6-4476-98ea-cdf7228b6a6b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.517199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fa9e2-e6d6-42f9-8f81-c87a8889322c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:15.518871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fa9e2-e6d6-42f9-8f81-c87a8889322c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:15.526298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0094f-78fe-48fb-a781-abd85d6c4c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.527103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0094f-78fe-48fb-a781-abd85d6c4c16 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.527382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0094f-78fe-48fb-a781-abd85d6c4c16 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.527654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0094f-78fe-48fb-a781-abd85d6c4c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.544122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0094f-78fe-48fb-a781-abd85d6c4c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-78b0094f-78fe-48fb-a781-abd85d6c4c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:15.558524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:15.559439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 223/446] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:15.560335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0094f-78fe-48fb-a781-abd85d6c4c16 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:15.590796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:15.629119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 224/447] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:15.634955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fa9e2-e6d6-42f9-8f81-c87a8889322c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:15.645624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:15.660354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0094f-78fe-48fb-a781-abd85d6c4c16 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.692863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502355-3fcf-48fc-b534-f25a688a4c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.693526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502355-3fcf-48fc-b534-f25a688a4c70 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.693815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502355-3fcf-48fc-b534-f25a688a4c70 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.694095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502355-3fcf-48fc-b534-f25a688a4c70 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.694837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f502355-3fcf-48fc-b534-f25a688a4c70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:15.695148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f502355-3fcf-48fc-b534-f25a688a4c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:15.696563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f502355-3fcf-48fc-b534-f25a688a4c70 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:15.705156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 224/448] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:15.710574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502355-3fcf-48fc-b534-f25a688a4c70 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:15.732602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fa9e2-e6d6-42f9-8f81-c87a8889322c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.766854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb0dd-bfd4-4c82-90ce-d39e8dc01841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.767772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb0dd-bfd4-4c82-90ce-d39e8dc01841 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.768025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb0dd-bfd4-4c82-90ce-d39e8dc01841 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.768300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb0dd-bfd4-4c82-90ce-d39e8dc01841 None admin] PATH_INFO: `/v3/projects/de248ef10d024a0087f98dbd00a26a29` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.769483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eb0dd-bfd4-4c82-90ce-d39e8dc01841 None admin] RBAC: Authorizing `identity:get_project(project_id=de248ef10d024a0087f98dbd00a26a29)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:15.770942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eb0dd-bfd4-4c82-90ce-d39e8dc01841 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:15.772637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 225/449] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:15 2022] GET /identity/v3/projects/de248ef10d024a0087f98dbd00a26a29 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:15.777892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb0dd-bfd4-4c82-90ce-d39e8dc01841 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:15.806236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:15.812653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502355-3fcf-48fc-b534-f25a688a4c70 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.845929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e68f-450b-4e7e-9434-2b10f37532de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.846589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e68f-450b-4e7e-9434-2b10f37532de None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.846875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e68f-450b-4e7e-9434-2b10f37532de None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.847151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e68f-450b-4e7e-9434-2b10f37532de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.864630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:15.876054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb0dd-bfd4-4c82-90ce-d39e8dc01841 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:15.909353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29651a3d-f5cb-491b-bc27-14cb5b3e7fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:15.910296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29651a3d-f5cb-491b-bc27-14cb5b3e7fb1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.910585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29651a3d-f5cb-491b-bc27-14cb5b3e7fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.910860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29651a3d-f5cb-491b-bc27-14cb5b3e7fb1 None admin] PATH_INFO: `/v3/groups/e148bca31aa44115af4aa4f46a3eae74` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.912056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29651a3d-f5cb-491b-bc27-14cb5b3e7fb1 None admin] RBAC: Authorizing `identity:get_group(group_id=e148bca31aa44115af4aa4f46a3eae74)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:15.913510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29651a3d-f5cb-491b-bc27-14cb5b3e7fb1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:15.914425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8e68f-450b-4e7e-9434-2b10f37532de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:15.915111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 226/450] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:15 2022] GET /identity/v3/groups/e148bca31aa44115af4aa4f46a3eae74 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:15.915887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8e68f-450b-4e7e-9434-2b10f37532de None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:15.920727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29651a3d-f5cb-491b-bc27-14cb5b3e7fb1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:16.010999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 225/451] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:16.012205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:16.016501 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29651a3d-f5cb-491b-bc27-14cb5b3e7fb1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:16.016837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e68f-450b-4e7e-9434-2b10f37532de None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:16.052843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c97e-7871-4f4b-8e10-eba1089c8a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:16.053504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c97e-7871-4f4b-8e10-eba1089c8a1b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:16.053788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c97e-7871-4f4b-8e10-eba1089c8a1b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:16.054070 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c97e-7871-4f4b-8e10-eba1089c8a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:16.054898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c97e-7871-4f4b-8e10-eba1089c8a1b None admin] RBAC: Adding query filter params (group.id=e148bca31aa44115af4aa4f46a3eae74, role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=de248ef10d024a0087f98dbd00a26a29) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:16.055213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c97e-7871-4f4b-8e10-eba1089c8a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:16.056699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c97e-7871-4f4b-8e10-eba1089c8a1b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:16.063063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 227/452] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:15 2022] GET /identity/v3/role_assignments?group.id=e148bca31aa44115af4aa4f46a3eae74&scope.project.id=de248ef10d024a0087f98dbd00a26a29&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:16.066044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:16.119007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e68f-450b-4e7e-9434-2b10f37532de None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:16.154700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfe2c1-77bc-40ee-895c-67768d33d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:16.155566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfe2c1-77bc-40ee-895c-67768d33d06c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:16.155880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfe2c1-77bc-40ee-895c-67768d33d06c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:16.156151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfe2c1-77bc-40ee-895c-67768d33d06c None admin] PATH_INFO: `/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:16.157358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfe2c1-77bc-40ee-895c-67768d33d06c None admin] RBAC: Authorizing `identity:get_project(project_id=d3ad4439044a4113a3a2bd5f12c4d6da)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:16.158800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfe2c1-77bc-40ee-895c-67768d33d06c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:16.160558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 226/453] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:20:16 2022] GET /identity/v3/projects/d3ad4439044a4113a3a2bd5f12c4d6da => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:16.166133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c97e-7871-4f4b-8e10-eba1089c8a1b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:16.267210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c97e-7871-4f4b-8e10-eba1089c8a1b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:16.302533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64fdaa-6338-4cb5-b1c6-9d6383baa899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:16.303321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64fdaa-6338-4cb5-b1c6-9d6383baa899 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:16.303601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64fdaa-6338-4cb5-b1c6-9d6383baa899 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:16.303906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64fdaa-6338-4cb5-b1c6-9d6383baa899 None admin] PATH_INFO: `/v3/groups/26858142a1ee4f6092717e4fd2228704` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:16.305081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64fdaa-6338-4cb5-b1c6-9d6383baa899 None admin] RBAC: Authorizing `identity:get_group(group_id=26858142a1ee4f6092717e4fd2228704)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:16.306526 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64fdaa-6338-4cb5-b1c6-9d6383baa899 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:16.308395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 228/454] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 16 00:20:16 2022] GET /identity/v3/groups/26858142a1ee4f6092717e4fd2228704 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:16.314772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfe2c1-77bc-40ee-895c-67768d33d06c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:16.415081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfe2c1-77bc-40ee-895c-67768d33d06c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:16.432168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:16.448783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04f1d7-e348-40c9-ba8a-d6e267fa9b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:16.449437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f1d7-e348-40c9-ba8a-d6e267fa9b64 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:16.449721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f1d7-e348-40c9-ba8a-d6e267fa9b64 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:16.449998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f1d7-e348-40c9-ba8a-d6e267fa9b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:16.450912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04f1d7-e348-40c9-ba8a-d6e267fa9b64 None admin] RBAC: Adding query filter params (group.id=26858142a1ee4f6092717e4fd2228704, role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=d3ad4439044a4113a3a2bd5f12c4d6da) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:16.451317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04f1d7-e348-40c9-ba8a-d6e267fa9b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:16.452787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04f1d7-e348-40c9-ba8a-d6e267fa9b64 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:16.458380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 227/455] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 16 00:20:16 2022] GET /identity/v3/role_assignments?group.id=26858142a1ee4f6092717e4fd2228704&scope.project.id=d3ad4439044a4113a3a2bd5f12c4d6da&role.id=635caa85d8524fb887206fd521defd3f => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:19.046881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d709a8-7bec-45eb-96b4-6562a74b40ae None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.047704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d709a8-7bec-45eb-96b4-6562a74b40ae None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.048228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d709a8-7bec-45eb-96b4-6562a74b40ae None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.050116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 229/456] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:19.061577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd596-2683-44a4-8704-d3e1e90f64fd None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.062034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd596-2683-44a4-8704-d3e1e90f64fd None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.062109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd596-2683-44a4-8704-d3e1e90f64fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.085677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8bfbd596-2683-44a4-8704-d3e1e90f64fd None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:19.086873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8bfbd596-2683-44a4-8704-d3e1e90f64fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:19.173896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 228/457] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:19.213901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d709a8-7bec-45eb-96b4-6562a74b40ae None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:19.261627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:19.307855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8a57d-187d-4a2b-b6a4-127ef449b125 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.308377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8a57d-187d-4a2b-b6a4-127ef449b125 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.308657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8a57d-187d-4a2b-b6a4-127ef449b125 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.311965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 229/458] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:19.316651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaef71-6805-4f82-9d08-fda30fc067c2 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.316939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaef71-6805-4f82-9d08-fda30fc067c2 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.317216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaef71-6805-4f82-9d08-fda30fc067c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.346411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3acaef71-6805-4f82-9d08-fda30fc067c2 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:19.347645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3acaef71-6805-4f82-9d08-fda30fc067c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:19.379827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d709a8-7bec-45eb-96b4-6562a74b40ae None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:19.430287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3786bef-6a81-4d52-b8c3-aad5bead97e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:19.431546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3786bef-6a81-4d52-b8c3-aad5bead97e3 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.432085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3786bef-6a81-4d52-b8c3-aad5bead97e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.432632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3786bef-6a81-4d52-b8c3-aad5bead97e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.444012 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3786bef-6a81-4d52-b8c3-aad5bead97e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:19.445841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3786bef-6a81-4d52-b8c3-aad5bead97e3 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:19.456461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 230/459] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:20:19.458268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0118-8be3-4651-ba29-e48972168864 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.458729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0118-8be3-4651-ba29-e48972168864 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.459146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0118-8be3-4651-ba29-e48972168864 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.460566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 231/460] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-d3786bef-6a81-4d52-b8c3-aad5bead97e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:19.469952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:19.470815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:19.471634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:19.471634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:19.471634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:19.471634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:19.472986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f23e-b815-45a8-afda-9d509a9e8394 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.473277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f23e-b815-45a8-afda-9d509a9e8394 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.473554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f23e-b815-45a8-afda-9d509a9e8394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.474418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 230/461] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:19.480288 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3786bef-6a81-4d52-b8c3-aad5bead97e3 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:19.501180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-afc0f23e-b815-45a8-afda-9d509a9e8394 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:19.502778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-afc0f23e-b815-45a8-afda-9d509a9e8394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:19.545231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:19.578593 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:19.587772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 232/462] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:19.587772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f23e-b815-45a8-afda-9d509a9e8394 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:19.611083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3786bef-6a81-4d52-b8c3-aad5bead97e3 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:19.656516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5542-8f9b-43c4-9f70-883f8772ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:19.657190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5542-8f9b-43c4-9f70-883f8772ee38 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.657472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5542-8f9b-43c4-9f70-883f8772ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.657751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5542-8f9b-43c4-9f70-883f8772ee38 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.658480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5542-8f9b-43c4-9f70-883f8772ee38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:19.658777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5542-8f9b-43c4-9f70-883f8772ee38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:19.660204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5542-8f9b-43c4-9f70-883f8772ee38 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:19.677674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 231/463] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:19.678477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5542-8f9b-43c4-9f70-883f8772ee38 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:19.702849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f23e-b815-45a8-afda-9d509a9e8394 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:19.745649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58b734-51c1-4468-989e-e2c5c7c78dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:19.746767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b734-51c1-4468-989e-e2c5c7c78dfd None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.747374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b734-51c1-4468-989e-e2c5c7c78dfd None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.748590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b734-51c1-4468-989e-e2c5c7c78dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.760919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58b734-51c1-4468-989e-e2c5c7c78dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:19.762988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58b734-51c1-4468-989e-e2c5c7c78dfd None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:19.777268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5542-8f9b-43c4-9f70-883f8772ee38 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-ca58b734-51c1-4468-989e-e2c5c7c78dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:19.783167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:19.784030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:19.784858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:19.784858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:19.784858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:19.784858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:19.784858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 233/464] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:19.790305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132898-dff2-47fa-8fc0-375e97b250a9 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.790594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132898-dff2-47fa-8fc0-375e97b250a9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.790870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132898-dff2-47fa-8fc0-375e97b250a9 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.792299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 234/465] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:19.796446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132898-dff2-47fa-8fc0-375e97b250a9 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:19.815858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0754955-a3be-4ade-a6f7-4d06ac224fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:19.816682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754955-a3be-4ade-a6f7-4d06ac224fd6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.816966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754955-a3be-4ade-a6f7-4d06ac224fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.817243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754955-a3be-4ade-a6f7-4d06ac224fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.827706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0754955-a3be-4ade-a6f7-4d06ac224fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:19.828885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:19.829198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0754955-a3be-4ade-a6f7-4d06ac224fd6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:19.831231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-e0754955-a3be-4ade-a6f7-4d06ac224fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:19.848110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:19.848969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:19.849798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:19.849798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:19.849798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:19.849798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:19.849798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 232/466] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:19.850539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0754955-a3be-4ade-a6f7-4d06ac224fd6 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:19.913960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132898-dff2-47fa-8fc0-375e97b250a9 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:19.949813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1838eba-42fd-4aae-af0f-613a9552de23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:19.950528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1838eba-42fd-4aae-af0f-613a9552de23 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.951284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1838eba-42fd-4aae-af0f-613a9552de23 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.951566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1838eba-42fd-4aae-af0f-613a9552de23 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.952310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1838eba-42fd-4aae-af0f-613a9552de23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:19.953769 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1838eba-42fd-4aae-af0f-613a9552de23 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:19.958768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0754955-a3be-4ade-a6f7-4d06ac224fd6 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:19.993288 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a17914-fcba-4e2e-84b9-3deb6cd5b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:19.993976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a17914-fcba-4e2e-84b9-3deb6cd5b950 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.994263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a17914-fcba-4e2e-84b9-3deb6cd5b950 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.994549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a17914-fcba-4e2e-84b9-3deb6cd5b950 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.995266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a17914-fcba-4e2e-84b9-3deb6cd5b950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:19.995578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a17914-fcba-4e2e-84b9-3deb6cd5b950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:19.996990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a17914-fcba-4e2e-84b9-3deb6cd5b950 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:20.013947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 233/467] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:20.013947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c469ed-bded-43f9-b31f-d83ab2a079c1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.013947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c469ed-bded-43f9-b31f-d83ab2a079c1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.013947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c469ed-bded-43f9-b31f-d83ab2a079c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.029445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-51c469ed-bded-43f9-b31f-d83ab2a079c1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:20.031050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 235/468] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:20:19 2022] POST /identity/v3/users => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:20:20.031160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-51c469ed-bded-43f9-b31f-d83ab2a079c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:20.037777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1838eba-42fd-4aae-af0f-613a9552de23 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:20.104615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:20.128570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 234/469] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:20.131297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c469ed-bded-43f9-b31f-d83ab2a079c1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:20.147700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:20.174706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1838eba-42fd-4aae-af0f-613a9552de23 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:20.212835 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63e65d-e024-418e-a854-6c34b70556f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:20.213511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63e65d-e024-418e-a854-6c34b70556f7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.213804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63e65d-e024-418e-a854-6c34b70556f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.214073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63e65d-e024-418e-a854-6c34b70556f7 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.214805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63e65d-e024-418e-a854-6c34b70556f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:20.215113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63e65d-e024-418e-a854-6c34b70556f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:20.216594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63e65d-e024-418e-a854-6c34b70556f7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:20.229734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 236/470] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:20.230877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63e65d-e024-418e-a854-6c34b70556f7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:20.264380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c469ed-bded-43f9-b31f-d83ab2a079c1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:20.305546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d090b7-cbe2-4a4b-af0b-810c168a480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:20.306211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d090b7-cbe2-4a4b-af0b-810c168a480f None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.306497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d090b7-cbe2-4a4b-af0b-810c168a480f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.306775 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d090b7-cbe2-4a4b-af0b-810c168a480f None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.307475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d090b7-cbe2-4a4b-af0b-810c168a480f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:20.309776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d090b7-cbe2-4a4b-af0b-810c168a480f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:20.350153 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63e65d-e024-418e-a854-6c34b70556f7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:20.390885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678e9ea-e788-4e35-8239-a42ba4bd7193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:20.392041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678e9ea-e788-4e35-8239-a42ba4bd7193 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.392521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678e9ea-e788-4e35-8239-a42ba4bd7193 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.393018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678e9ea-e788-4e35-8239-a42ba4bd7193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.401736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:20.408536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 235/471] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:20:20 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:20:20.408536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d090b7-cbe2-4a4b-af0b-810c168a480f None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:20.409148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678e9ea-e788-4e35-8239-a42ba4bd7193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:20.416435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678e9ea-e788-4e35-8239-a42ba4bd7193 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-0678e9ea-e788-4e35-8239-a42ba4bd7193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:20.453034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:20.456794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:20.457651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:20.457651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:20.457651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:20.457651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:20.457651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 237/472] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:20.461765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678e9ea-e788-4e35-8239-a42ba4bd7193 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:20.528144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:20.584911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678e9ea-e788-4e35-8239-a42ba4bd7193 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:20.594723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d090b7-cbe2-4a4b-af0b-810c168a480f None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:20.627368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bedf26-a936-4bfb-ad06-7a4cee17e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:20.628092 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bedf26-a936-4bfb-ad06-7a4cee17e237 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.628372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bedf26-a936-4bfb-ad06-7a4cee17e237 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.629267 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bedf26-a936-4bfb-ad06-7a4cee17e237 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.629367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bedf26-a936-4bfb-ad06-7a4cee17e237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:20.629649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bedf26-a936-4bfb-ad06-7a4cee17e237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:20.631361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bedf26-a936-4bfb-ad06-7a4cee17e237 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:20.644679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b105c8-e523-4f12-97b6-5a6aee4be486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:20.645030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 238/473] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:20.645287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b105c8-e523-4f12-97b6-5a6aee4be486 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.645570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b105c8-e523-4f12-97b6-5a6aee4be486 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.645845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b105c8-e523-4f12-97b6-5a6aee4be486 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.646197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b74b3d-c00b-436e-a2f1-714550db1ad7 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.646537 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b74b3d-c00b-436e-a2f1-714550db1ad7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.646629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b105c8-e523-4f12-97b6-5a6aee4be486 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:20.646818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b74b3d-c00b-436e-a2f1-714550db1ad7 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.648772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 239/474] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:20.652097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b105c8-e523-4f12-97b6-5a6aee4be486 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:20.655627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b74b3d-c00b-436e-a2f1-714550db1ad7 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:20.720098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:20.748981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 236/475] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:20:20 2022] POST /identity/v3/users => generated 248 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:20:20.755481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e927c9c-14e1-453d-ad56-325eff3f3886 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.755481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e927c9c-14e1-453d-ad56-325eff3f3886 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.755481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e927c9c-14e1-453d-ad56-325eff3f3886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.795190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-1e927c9c-14e1-453d-ad56-325eff3f3886 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:20.796563 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1e927c9c-14e1-453d-ad56-325eff3f3886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:20.809657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b74b3d-c00b-436e-a2f1-714550db1ad7 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:20.893490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ebbbc-f90f-4397-a30c-84a7c4870900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:20.894291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ebbbc-f90f-4397-a30c-84a7c4870900 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.894607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ebbbc-f90f-4397-a30c-84a7c4870900 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.894939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ebbbc-f90f-4397-a30c-84a7c4870900 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.895603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ebbbc-f90f-4397-a30c-84a7c4870900 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:20.897159 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ebbbc-f90f-4397-a30c-84a7c4870900 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:20.937916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 237/476] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:20.960810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e927c9c-14e1-453d-ad56-325eff3f3886 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:20.979517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 240/477] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:20:20 2022] POST /identity/v3/users => generated 249 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:20:20.998082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:21.079499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e927c9c-14e1-453d-ad56-325eff3f3886 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:21.119589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:21.120354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:21.120586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:21.120863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:21.121606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:21.123053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:21.158943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.sql.core [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:20:21.158943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 00:20:21.158943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [parameters: {'id': 'b44cbf3a916a4d71af4d86d537853dbe', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 00:20:21.158943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97110) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application result.read() Jun 16 00:20:21.176905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:20:21.177792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application yield resource Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise self.value Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application session.commit() Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:20:21.178675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:20:21.179520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:20:21.180508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application result.read() Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:20:21.181413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [parameters: {'id': 'b44cbf3a916a4d71af4d86d537853dbe', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:21.183635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 00:20:21.185565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:21.187567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 238/478] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 16 00:20:20 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:21.187702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ebbbc-f90f-4397-a30c-84a7c4870900 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:21.293981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ebbbc-f90f-4397-a30c-84a7c4870900 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:21.302106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:21.330691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204cb1c-c508-413b-a448-3dbd943aa4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:21.331554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204cb1c-c508-413b-a448-3dbd943aa4ac None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:21.331872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204cb1c-c508-413b-a448-3dbd943aa4ac None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:21.332238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204cb1c-c508-413b-a448-3dbd943aa4ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:21.345341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204cb1c-c508-413b-a448-3dbd943aa4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-c204cb1c-c508-413b-a448-3dbd943aa4ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:21.353993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:21.356947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:21.358332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 241/479] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:20:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:21.361538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:21.462458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:21.472626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffcf68-197e-472c-b76f-161e1abc83b2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:21.507366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d14b3-ca92-4757-adf0-34fbfafb3c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:21.508071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d14b3-ca92-4757-adf0-34fbfafb3c79 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:21.508404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d14b3-ca92-4757-adf0-34fbfafb3c79 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:21.508686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d14b3-ca92-4757-adf0-34fbfafb3c79 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:21.509437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d14b3-ca92-4757-adf0-34fbfafb3c79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:21.509743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d14b3-ca92-4757-adf0-34fbfafb3c79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:21.511179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d14b3-ca92-4757-adf0-34fbfafb3c79 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:21.521013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 239/480] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:22.567680 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a8751-7317-4d15-a175-b0e9a92b28ff None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:22.568205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a8751-7317-4d15-a175-b0e9a92b28ff None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:22.568280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a8751-7317-4d15-a175-b0e9a92b28ff None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:22.569848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 242/481] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:22.575212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0492f2-795a-4268-9e18-fd4cdf9780b1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:22.575656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0492f2-795a-4268-9e18-fd4cdf9780b1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:22.575838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0492f2-795a-4268-9e18-fd4cdf9780b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:22.600843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ae0492f2-795a-4268-9e18-fd4cdf9780b1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:22.602363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ae0492f2-795a-4268-9e18-fd4cdf9780b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:22.694113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 240/482] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:22.732678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a8751-7317-4d15-a175-b0e9a92b28ff None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:22.860553 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a8751-7317-4d15-a175-b0e9a92b28ff None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:22.903000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03298ca3-8dea-469f-be65-be15ca39f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:22.904002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03298ca3-8dea-469f-be65-be15ca39f4d4 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:22.904880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03298ca3-8dea-469f-be65-be15ca39f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:22.905097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03298ca3-8dea-469f-be65-be15ca39f4d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:22.926574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03298ca3-8dea-469f-be65-be15ca39f4d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:22.938850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83c0df-0b4d-4339-b482-e578a84ca10a None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:22.939139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83c0df-0b4d-4339-b482-e578a84ca10a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:22.939418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83c0df-0b4d-4339-b482-e578a84ca10a None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:22.941124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 241/483] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-03298ca3-8dea-469f-be65-be15ca39f4d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:22.942767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:22.943617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:22.944438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 243/484] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:22.948986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591734d2-c261-431e-8a13-af363cca2f34 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:22.949388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03298ca3-8dea-469f-be65-be15ca39f4d4 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:22.949734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591734d2-c261-431e-8a13-af363cca2f34 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:22.950210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591734d2-c261-431e-8a13-af363cca2f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:22.972533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-591734d2-c261-431e-8a13-af363cca2f34 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:22.975279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-591734d2-c261-431e-8a13-af363cca2f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:22.999549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:23.102411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03298ca3-8dea-469f-be65-be15ca39f4d4 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:23.113451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 242/485] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:23.142487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7c8a-4291-4001-b304-457534dd1a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:23.143093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7c8a-4291-4001-b304-457534dd1a9c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.143371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7c8a-4291-4001-b304-457534dd1a9c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.143645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7c8a-4291-4001-b304-457534dd1a9c None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.144416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd7c8a-4291-4001-b304-457534dd1a9c None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:23.144722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd7c8a-4291-4001-b304-457534dd1a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:23.146110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd7c8a-4291-4001-b304-457534dd1a9c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:23.148807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591734d2-c261-431e-8a13-af363cca2f34 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:23.155715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 244/486] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:23.161214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7c8a-4291-4001-b304-457534dd1a9c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:23.172605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:23.253958 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:23.266822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7c8a-4291-4001-b304-457534dd1a9c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:23.304004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8fbe6-ef7c-4857-85d7-12a76b1e5ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:23.305292 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8fbe6-ef7c-4857-85d7-12a76b1e5ff1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.305582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8fbe6-ef7c-4857-85d7-12a76b1e5ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.305862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8fbe6-ef7c-4857-85d7-12a76b1e5ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.318528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8fbe6-ef7c-4857-85d7-12a76b1e5ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:23.320171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8fbe6-ef7c-4857-85d7-12a76b1e5ff1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-1db8fbe6-ef7c-4857-85d7-12a76b1e5ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:23.341714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:23.342586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:23.343489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:23.343489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:23.343489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:23.343489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:23.347636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 245/487] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:23.348883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8fbe6-ef7c-4857-85d7-12a76b1e5ff1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:23.461047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8fbe6-ef7c-4857-85d7-12a76b1e5ff1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:23.485840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591734d2-c261-431e-8a13-af363cca2f34 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:23.531250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d508a4-656b-4276-ac85-425986cb32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:23.531972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d508a4-656b-4276-ac85-425986cb32e2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.532253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d508a4-656b-4276-ac85-425986cb32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.532526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d508a4-656b-4276-ac85-425986cb32e2 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.533279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d508a4-656b-4276-ac85-425986cb32e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:23.533587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d508a4-656b-4276-ac85-425986cb32e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:23.535012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d508a4-656b-4276-ac85-425986cb32e2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:23.540040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734030fc-a508-45c7-a384-666901c8bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:23.540868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734030fc-a508-45c7-a384-666901c8bc4a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.541149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734030fc-a508-45c7-a384-666901c8bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.541420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734030fc-a508-45c7-a384-666901c8bc4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.553656 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:23.557884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 246/488] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:23.559286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff978-c889-4860-bf1c-4e203e5d85d3 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.559578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff978-c889-4860-bf1c-4e203e5d85d3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.559995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff978-c889-4860-bf1c-4e203e5d85d3 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.562400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734030fc-a508-45c7-a384-666901c8bc4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:23.565694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 247/489] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:23.566525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdff978-c889-4860-bf1c-4e203e5d85d3 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-734030fc-a508-45c7-a384-666901c8bc4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:23.571379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:23.572277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:23.573067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 243/490] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:23.575773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eef061-ebe7-4b30-b9f7-f5d058643db0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.575773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eef061-ebe7-4b30-b9f7-f5d058643db0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.575773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eef061-ebe7-4b30-b9f7-f5d058643db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.600328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c0eef061-ebe7-4b30-b9f7-f5d058643db0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:23.602528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c0eef061-ebe7-4b30-b9f7-f5d058643db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:23.671795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 244/491] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:23.673872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdff978-c889-4860-bf1c-4e203e5d85d3 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:23.677465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eef061-ebe7-4b30-b9f7-f5d058643db0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:23.679943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:23.713125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f214-9719-4eba-851c-e33ec45169cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:23.713836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f214-9719-4eba-851c-e33ec45169cf None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.714235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f214-9719-4eba-851c-e33ec45169cf None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.714475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f214-9719-4eba-851c-e33ec45169cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.721435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521f214-9719-4eba-851c-e33ec45169cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:23.722881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521f214-9719-4eba-851c-e33ec45169cf None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-8521f214-9719-4eba-851c-e33ec45169cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:23.739521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:23.740417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:23.741288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 248/492] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 16 00:20:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:23.742462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e6102-5ad4-466b-af1d-f1a034910020 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.742462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e6102-5ad4-466b-af1d-f1a034910020 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.742462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e6102-5ad4-466b-af1d-f1a034910020 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.747999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 249/493] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:23.747999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e6102-5ad4-466b-af1d-f1a034910020 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:23.793879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eef061-ebe7-4b30-b9f7-f5d058643db0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:23.815237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:23.831476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef297-835d-4ce2-b28b-56f076e437d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:23.832217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef297-835d-4ce2-b28b-56f076e437d0 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.832557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef297-835d-4ce2-b28b-56f076e437d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.832840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef297-835d-4ce2-b28b-56f076e437d0 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.833587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef297-835d-4ce2-b28b-56f076e437d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:23.833895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef297-835d-4ce2-b28b-56f076e437d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:23.835277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef297-835d-4ce2-b28b-56f076e437d0 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:23.847895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 245/494] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:23.847895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef297-835d-4ce2-b28b-56f076e437d0 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:23.863306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e6102-5ad4-466b-af1d-f1a034910020 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:23.900925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b2d59-a695-4bd6-940c-b0d128f50cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:23.901829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b2d59-a695-4bd6-940c-b0d128f50cbb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.902197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b2d59-a695-4bd6-940c-b0d128f50cbb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.902490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b2d59-a695-4bd6-940c-b0d128f50cbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.913222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b2d59-a695-4bd6-940c-b0d128f50cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:23.914902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e21b2d59-a695-4bd6-940c-b0d128f50cbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:23.921560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:23.928370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 250/495] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:23.929574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98d45-5e0b-495e-ac55-d3cd3d9bcf16 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.930266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98d45-5e0b-495e-ac55-d3cd3d9bcf16 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.930266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98d45-5e0b-495e-ac55-d3cd3d9bcf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.943436 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-82d98d45-5e0b-495e-ac55-d3cd3d9bcf16 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:23.944666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-82d98d45-5e0b-495e-ac55-d3cd3d9bcf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:23.963636 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef297-835d-4ce2-b28b-56f076e437d0 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.000584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3eaff-29f5-4a2a-9d5a-a74c91d6e4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.002145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3eaff-29f5-4a2a-9d5a-a74c91d6e4d5 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.002605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3eaff-29f5-4a2a-9d5a-a74c91d6e4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.003051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3eaff-29f5-4a2a-9d5a-a74c91d6e4d5 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.004527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3eaff-29f5-4a2a-9d5a-a74c91d6e4d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:24.005268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3eaff-29f5-4a2a-9d5a-a74c91d6e4d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:24.007585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3eaff-29f5-4a2a-9d5a-a74c91d6e4d5 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:24.011336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 251/496] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:24.012207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98d45-5e0b-495e-ac55-d3cd3d9bcf16 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.056750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 246/497] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 16 00:20:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:24.060784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3eaff-29f5-4a2a-9d5a-a74c91d6e4d5 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.071969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:24.129649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98d45-5e0b-495e-ac55-d3cd3d9bcf16 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.164150 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3eaff-29f5-4a2a-9d5a-a74c91d6e4d5 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.165918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d0da1-518d-4504-9edf-427f301ac6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.166817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d0da1-518d-4504-9edf-427f301ac6d7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.167100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d0da1-518d-4504-9edf-427f301ac6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.167359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d0da1-518d-4504-9edf-427f301ac6d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.178293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d0da1-518d-4504-9edf-427f301ac6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:24.180012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d0da1-518d-4504-9edf-427f301ac6d7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:24.188899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-fe5d0da1-518d-4504-9edf-427f301ac6d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:24.199242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:24.200396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:24.201254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:24.201254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:24.201254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:24.201254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:24.201254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 252/498] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:24.201508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333e312-52c9-4951-a89c-095cb72d81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.201934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333e312-52c9-4951-a89c-095cb72d81dd None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.202028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333e312-52c9-4951-a89c-095cb72d81dd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.202242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333e312-52c9-4951-a89c-095cb72d81dd None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.203012 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333e312-52c9-4951-a89c-095cb72d81dd None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:24.203329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333e312-52c9-4951-a89c-095cb72d81dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:24.204751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333e312-52c9-4951-a89c-095cb72d81dd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:24.205841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d0da1-518d-4504-9edf-427f301ac6d7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.213179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 247/499] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:24.214856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333e312-52c9-4951-a89c-095cb72d81dd None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.315250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d0da1-518d-4504-9edf-427f301ac6d7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.317069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:24.321278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333e312-52c9-4951-a89c-095cb72d81dd None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.352941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96df8-8186-4023-ae17-eed1a8a20dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.353735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96df8-8186-4023-ae17-eed1a8a20dad None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.354025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96df8-8186-4023-ae17-eed1a8a20dad None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.354302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96df8-8186-4023-ae17-eed1a8a20dad None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.357112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb44e7-0c0f-40b6-83f2-e2003d56038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.357945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb44e7-0c0f-40b6-83f2-e2003d56038c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.358400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb44e7-0c0f-40b6-83f2-e2003d56038c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.358845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb44e7-0c0f-40b6-83f2-e2003d56038c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.364425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba96df8-8186-4023-ae17-eed1a8a20dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-0ba96df8-8186-4023-ae17-eed1a8a20dad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:24.372074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:24.373121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:24.373928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 253/500] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:24.374636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96df8-8186-4023-ae17-eed1a8a20dad None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.424616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:24.442418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb44e7-0c0f-40b6-83f2-e2003d56038c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:24.443945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb44e7-0c0f-40b6-83f2-e2003d56038c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:24.486650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96df8-8186-4023-ae17-eed1a8a20dad None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.519071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efcfe4-909e-416b-9a1e-6d84658b1649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.519717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efcfe4-909e-416b-9a1e-6d84658b1649 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.520028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efcfe4-909e-416b-9a1e-6d84658b1649 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.520300 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efcfe4-909e-416b-9a1e-6d84658b1649 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.521009 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efcfe4-909e-416b-9a1e-6d84658b1649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:24.521308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efcfe4-909e-416b-9a1e-6d84658b1649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:24.522710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efcfe4-909e-416b-9a1e-6d84658b1649 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:24.538828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 254/501] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:24.538828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efcfe4-909e-416b-9a1e-6d84658b1649 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.547385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 248/502] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:24.548248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb44e7-0c0f-40b6-83f2-e2003d56038c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.558363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:24.629089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:24.632781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efcfe4-909e-416b-9a1e-6d84658b1649 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.645052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb44e7-0c0f-40b6-83f2-e2003d56038c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.665864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe04b9-c8bf-4f18-8651-55c7a5a7123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.666638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe04b9-c8bf-4f18-8651-55c7a5a7123f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.666915 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe04b9-c8bf-4f18-8651-55c7a5a7123f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.667183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe04b9-c8bf-4f18-8651-55c7a5a7123f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.676973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe04b9-c8bf-4f18-8651-55c7a5a7123f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:24.678420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe04b9-c8bf-4f18-8651-55c7a5a7123f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:24.678701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17391798-a186-40c7-895c-df7b046a873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.679384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17391798-a186-40c7-895c-df7b046a873c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.679667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17391798-a186-40c7-895c-df7b046a873c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.680067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17391798-a186-40c7-895c-df7b046a873c None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.680692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17391798-a186-40c7-895c-df7b046a873c None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:24.681002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17391798-a186-40c7-895c-df7b046a873c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:24.682368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17391798-a186-40c7-895c-df7b046a873c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:24.690582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 249/503] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:24.691793 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d2d7-fab9-424e-8847-8a1d39ae0823 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.692082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d2d7-fab9-424e-8847-8a1d39ae0823 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.692363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d2d7-fab9-424e-8847-8a1d39ae0823 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.695385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 250/504] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:24.695385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819d2d7-fab9-424e-8847-8a1d39ae0823 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-2fbe04b9-c8bf-4f18-8651-55c7a5a7123f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:24.696244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:24.697037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:24.703536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:24.703536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:24.703536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:24.703536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:24.703536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 255/505] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:24.703536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe04b9-c8bf-4f18-8651-55c7a5a7123f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.769774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:24.793821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe04b9-c8bf-4f18-8651-55c7a5a7123f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.795175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819d2d7-fab9-424e-8847-8a1d39ae0823 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.828180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc4cfb-f2dd-4224-979b-892c913abf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.828962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc4cfb-f2dd-4224-979b-892c913abf4a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.829066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c352-3c5f-4f40-9816-9fdf3457a041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.829241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc4cfb-f2dd-4224-979b-892c913abf4a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.829515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc4cfb-f2dd-4224-979b-892c913abf4a None admin] PATH_INFO: `/v3/users/glance` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.829796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c352-3c5f-4f40-9816-9fdf3457a041 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.830082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c352-3c5f-4f40-9816-9fdf3457a041 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.830358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c352-3c5f-4f40-9816-9fdf3457a041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.836854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc4cfb-f2dd-4224-979b-892c913abf4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:24.838308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc4cfb-f2dd-4224-979b-892c913abf4a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:24.840468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11c352-3c5f-4f40-9816-9fdf3457a041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:24.841904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11c352-3c5f-4f40-9816-9fdf3457a041 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-46fc4cfb-f2dd-4224-979b-892c913abf4a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:24.853327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:24.854184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:24.855102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 251/506] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:24.856445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc4cfb-f2dd-4224-979b-892c913abf4a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-3b11c352-3c5f-4f40-9816-9fdf3457a041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:24.859383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:24.860351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:24.861399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:24.861399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:24.861399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:24.861399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:24.861399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 256/507] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:24.862050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdcea8-54f1-499c-b73f-f269235f1af5 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.862205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdcea8-54f1-499c-b73f-f269235f1af5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.862493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdcea8-54f1-499c-b73f-f269235f1af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:24.870738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:24.881177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-13bdcea8-54f1-499c-b73f-f269235f1af5 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:24.882662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-13bdcea8-54f1-499c-b73f-f269235f1af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:24.947265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 257/508] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:24.948191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdcea8-54f1-499c-b73f-f269235f1af5 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:24.961266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc4cfb-f2dd-4224-979b-892c913abf4a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:24.996073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aab5b4-4126-41fa-bb72-f93678210816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:24.996865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aab5b4-4126-41fa-bb72-f93678210816 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.997151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aab5b4-4126-41fa-bb72-f93678210816 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.997949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aab5b4-4126-41fa-bb72-f93678210816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.005838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:25.008586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aab5b4-4126-41fa-bb72-f93678210816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.010090 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aab5b4-4126-41fa-bb72-f93678210816 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-82aab5b4-4126-41fa-bb72-f93678210816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:25.027760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:25.028779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:25.034308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:25.034308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:25.034308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:25.034308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:25.034308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 252/509] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:25.034308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aab5b4-4126-41fa-bb72-f93678210816 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.050080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdcea8-54f1-499c-b73f-f269235f1af5 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.084567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6274d-5706-45e0-8920-1932e68d00f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.085226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6274d-5706-45e0-8920-1932e68d00f0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.085504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6274d-5706-45e0-8920-1932e68d00f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.085777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6274d-5706-45e0-8920-1932e68d00f0 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.086481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6274d-5706-45e0-8920-1932e68d00f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:25.086784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6274d-5706-45e0-8920-1932e68d00f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.088187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6274d-5706-45e0-8920-1932e68d00f0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.088280 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:25.099441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 258/510] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:25.104914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6274d-5706-45e0-8920-1932e68d00f0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.132921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aab5b4-4126-41fa-bb72-f93678210816 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.165698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68729feb-064b-4da5-a73b-d8e51172230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.166367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68729feb-064b-4da5-a73b-d8e51172230e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.166648 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68729feb-064b-4da5-a73b-d8e51172230e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.166926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68729feb-064b-4da5-a73b-d8e51172230e None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.167771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68729feb-064b-4da5-a73b-d8e51172230e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:25.168087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68729feb-064b-4da5-a73b-d8e51172230e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.170050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68729feb-064b-4da5-a73b-d8e51172230e None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.187116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 253/511] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:25.187945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68729feb-064b-4da5-a73b-d8e51172230e None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.198528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6274d-5706-45e0-8920-1932e68d00f0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.214098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:25.231048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252d49-a5cb-45ee-a12d-955295f88361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.232246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252d49-a5cb-45ee-a12d-955295f88361 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.232535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252d49-a5cb-45ee-a12d-955295f88361 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.232812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252d49-a5cb-45ee-a12d-955295f88361 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.233522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa252d49-a5cb-45ee-a12d-955295f88361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:25.233829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa252d49-a5cb-45ee-a12d-955295f88361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.235203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa252d49-a5cb-45ee-a12d-955295f88361 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.246409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 259/512] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:25.247174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252d49-a5cb-45ee-a12d-955295f88361 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.287273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68729feb-064b-4da5-a73b-d8e51172230e None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.303325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:25.320603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532eefe-3462-4831-b6ca-cb8de1311afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.321392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532eefe-3462-4831-b6ca-cb8de1311afb None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.321672 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532eefe-3462-4831-b6ca-cb8de1311afb None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.321944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532eefe-3462-4831-b6ca-cb8de1311afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.332030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532eefe-3462-4831-b6ca-cb8de1311afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.333491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532eefe-3462-4831-b6ca-cb8de1311afb None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.347423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252d49-a5cb-45ee-a12d-955295f88361 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-e532eefe-3462-4831-b6ca-cb8de1311afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:25.351241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:25.352241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:25.353185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:25.353185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:25.353185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:25.353185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:25.353185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 254/513] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:25.357414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532eefe-3462-4831-b6ca-cb8de1311afb None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.380826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce49b6-a521-4b8b-821c-4870d27bc2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.381743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce49b6-a521-4b8b-821c-4870d27bc2f4 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.382027 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce49b6-a521-4b8b-821c-4870d27bc2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.382303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce49b6-a521-4b8b-821c-4870d27bc2f4 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.383007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce49b6-a521-4b8b-821c-4870d27bc2f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:25.383315 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce49b6-a521-4b8b-821c-4870d27bc2f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.384713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce49b6-a521-4b8b-821c-4870d27bc2f4 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.395655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 260/514] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:25.396483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce49b6-a521-4b8b-821c-4870d27bc2f4 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.430412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:25.456666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532eefe-3462-4831-b6ca-cb8de1311afb None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.491504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b67cf-7526-492a-a893-c310f9c1e378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.492324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b67cf-7526-492a-a893-c310f9c1e378 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.492606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b67cf-7526-492a-a893-c310f9c1e378 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.492882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b67cf-7526-492a-a893-c310f9c1e378 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.493422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce49b6-a521-4b8b-821c-4870d27bc2f4 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.499806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b67cf-7526-492a-a893-c310f9c1e378 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.501286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b67cf-7526-492a-a893-c310f9c1e378 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-005b67cf-7526-492a-a893-c310f9c1e378 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:25.516001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:25.516862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:25.517746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 255/515] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:25.518517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b67cf-7526-492a-a893-c310f9c1e378 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.530404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc2977-77e4-4b69-a01e-1f544d55676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.531045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc2977-77e4-4b69-a01e-1f544d55676c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.531330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc2977-77e4-4b69-a01e-1f544d55676c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.531608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc2977-77e4-4b69-a01e-1f544d55676c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.545748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:25.596962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc2977-77e4-4b69-a01e-1f544d55676c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.598411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc2977-77e4-4b69-a01e-1f544d55676c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.614907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b67cf-7526-492a-a893-c310f9c1e378 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.631014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:25.648982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141b602-b73a-42a1-b6e6-ad8f2e708e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.649758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141b602-b73a-42a1-b6e6-ad8f2e708e4d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.650045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141b602-b73a-42a1-b6e6-ad8f2e708e4d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.650314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141b602-b73a-42a1-b6e6-ad8f2e708e4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.657554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141b602-b73a-42a1-b6e6-ad8f2e708e4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.659004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141b602-b73a-42a1-b6e6-ad8f2e708e4d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b141b602-b73a-42a1-b6e6-ad8f2e708e4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:25.673870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:25.674887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 256/516] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:25.675921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141b602-b73a-42a1-b6e6-ad8f2e708e4d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.697125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 261/517] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:25.697948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc2977-77e4-4b69-a01e-1f544d55676c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.766800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:25.779641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141b602-b73a-42a1-b6e6-ad8f2e708e4d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.796678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc2977-77e4-4b69-a01e-1f544d55676c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.812531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f69ed8-a7a2-4339-b18a-72b53b6638ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.813190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f69ed8-a7a2-4339-b18a-72b53b6638ac None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.813485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f69ed8-a7a2-4339-b18a-72b53b6638ac None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.813768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f69ed8-a7a2-4339-b18a-72b53b6638ac None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.814492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f69ed8-a7a2-4339-b18a-72b53b6638ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:25.814879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f69ed8-a7a2-4339-b18a-72b53b6638ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.816258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f69ed8-a7a2-4339-b18a-72b53b6638ac None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.828202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 257/518] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:25.829057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f69ed8-a7a2-4339-b18a-72b53b6638ac None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.830385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce1328-ff89-4397-8025-36d7305a80a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.831176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1328-ff89-4397-8025-36d7305a80a1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.831459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1328-ff89-4397-8025-36d7305a80a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.831758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1328-ff89-4397-8025-36d7305a80a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.835393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:25.840827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce1328-ff89-4397-8025-36d7305a80a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.843067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce1328-ff89-4397-8025-36d7305a80a1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-f4ce1328-ff89-4397-8025-36d7305a80a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:25.858214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:25.859295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 262/519] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:25.860297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce1328-ff89-4397-8025-36d7305a80a1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.930078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f69ed8-a7a2-4339-b18a-72b53b6638ac None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.956586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce1328-ff89-4397-8025-36d7305a80a1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.963924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed578e-c6f1-4520-82f2-a13015a36ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.964589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed578e-c6f1-4520-82f2-a13015a36ed8 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.964875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed578e-c6f1-4520-82f2-a13015a36ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.965166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed578e-c6f1-4520-82f2-a13015a36ed8 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.966592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed578e-c6f1-4520-82f2-a13015a36ed8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:25.966910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed578e-c6f1-4520-82f2-a13015a36ed8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.968378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed578e-c6f1-4520-82f2-a13015a36ed8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.984976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 258/520] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:25.985555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed578e-c6f1-4520-82f2-a13015a36ed8 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.989098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a412a93-9762-4500-ad3b-796948f0b8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.989754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a412a93-9762-4500-ad3b-796948f0b8be None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.990039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a412a93-9762-4500-ad3b-796948f0b8be None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.990320 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a412a93-9762-4500-ad3b-796948f0b8be None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.991093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a412a93-9762-4500-ad3b-796948f0b8be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:25.991406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a412a93-9762-4500-ad3b-796948f0b8be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.992865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a412a93-9762-4500-ad3b-796948f0b8be None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.994937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:26.010820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 263/521] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:26.011444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a412a93-9762-4500-ad3b-796948f0b8be None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.070505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:26.084390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed578e-c6f1-4520-82f2-a13015a36ed8 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:26.112778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a412a93-9762-4500-ad3b-796948f0b8be None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:26.117955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc2ac-4b2e-4769-abdf-5df948a65939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:26.118746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc2ac-4b2e-4769-abdf-5df948a65939 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.119028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc2ac-4b2e-4769-abdf-5df948a65939 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.119303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc2ac-4b2e-4769-abdf-5df948a65939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.129082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dc2ac-4b2e-4769-abdf-5df948a65939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:26.130538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dc2ac-4b2e-4769-abdf-5df948a65939 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:26.145934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d6d3e-c41d-4e2e-9610-cfd26c86dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:26.146587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d6d3e-c41d-4e2e-9610-cfd26c86dad1 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.146865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d6d3e-c41d-4e2e-9610-cfd26c86dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.147137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d6d3e-c41d-4e2e-9610-cfd26c86dad1 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.147852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d6d3e-c41d-4e2e-9610-cfd26c86dad1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-a02dc2ac-4b2e-4769-abdf-5df948a65939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:26.148277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:26.149207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:26.150127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:26.150127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:26.150127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:26.150127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:26.150331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d6d3e-c41d-4e2e-9610-cfd26c86dad1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:26.150396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 259/522] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:26.150542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc2ac-4b2e-4769-abdf-5df948a65939 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.209707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:26.232116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 264/523] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:20:26 2022] POST /identity/v3/users => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:20:26.238459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d6d3e-c41d-4e2e-9610-cfd26c86dad1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.250784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc2ac-4b2e-4769-abdf-5df948a65939 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:26.299901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49a58b-54f2-45a3-9b11-7b45f9e6e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:26.300982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49a58b-54f2-45a3-9b11-7b45f9e6e71a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.300982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49a58b-54f2-45a3-9b11-7b45f9e6e71a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.301177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49a58b-54f2-45a3-9b11-7b45f9e6e71a None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.301989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49a58b-54f2-45a3-9b11-7b45f9e6e71a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:26.302299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49a58b-54f2-45a3-9b11-7b45f9e6e71a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:26.303883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49a58b-54f2-45a3-9b11-7b45f9e6e71a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:26.324739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 260/524] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 16 00:20:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:26.325408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49a58b-54f2-45a3-9b11-7b45f9e6e71a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.364320 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d6d3e-c41d-4e2e-9610-cfd26c86dad1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:26.379560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:26.401849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46140707-762d-45d3-b4ce-17a9c452c026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:26.402497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46140707-762d-45d3-b4ce-17a9c452c026 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.402770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46140707-762d-45d3-b4ce-17a9c452c026 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.403052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46140707-762d-45d3-b4ce-17a9c452c026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.446435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49a58b-54f2-45a3-9b11-7b45f9e6e71a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:26.463704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:26.481206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6ed0a-a95e-4ebe-99d4-982c804c777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:26.481898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6ed0a-a95e-4ebe-99d4-982c804c777f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.482180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6ed0a-a95e-4ebe-99d4-982c804c777f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.482363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46140707-762d-45d3-b4ce-17a9c452c026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:26.482487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6ed0a-a95e-4ebe-99d4-982c804c777f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.483325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6ed0a-a95e-4ebe-99d4-982c804c777f None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=ba29f9c029fe4390af3b6ce1b2147ce9) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:26.483926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46140707-762d-45d3-b4ce-17a9c452c026 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:26.484031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6ed0a-a95e-4ebe-99d4-982c804c777f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:26.485735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6ed0a-a95e-4ebe-99d4-982c804c777f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:26.492032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 261/525] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:26 2022] GET /identity/v3/role_assignments?user.id=ba29f9c029fe4390af3b6ce1b2147ce9&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:26.492901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6ed0a-a95e-4ebe-99d4-982c804c777f None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.611634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 265/526] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:26.611634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46140707-762d-45d3-b4ce-17a9c452c026 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.624313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:26.633397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6ed0a-a95e-4ebe-99d4-982c804c777f None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:26.673814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237a455-41b9-4913-a629-a20a253fe812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:26.675192 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237a455-41b9-4913-a629-a20a253fe812 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.675654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237a455-41b9-4913-a629-a20a253fe812 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.676137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237a455-41b9-4913-a629-a20a253fe812 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.677123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237a455-41b9-4913-a629-a20a253fe812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:26.677609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237a455-41b9-4913-a629-a20a253fe812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:26.679173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237a455-41b9-4913-a629-a20a253fe812 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:26.696544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 262/527] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:26.697679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237a455-41b9-4913-a629-a20a253fe812 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.725794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46140707-762d-45d3-b4ce-17a9c452c026 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:26.750799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:26.770322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596698e-b280-424a-a292-8e69e1978266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:26.770906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596698e-b280-424a-a292-8e69e1978266 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.771189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596698e-b280-424a-a292-8e69e1978266 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.771464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596698e-b280-424a-a292-8e69e1978266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.813446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237a455-41b9-4913-a629-a20a253fe812 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:26.844614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596698e-b280-424a-a292-8e69e1978266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:26.846084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596698e-b280-424a-a292-8e69e1978266 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:26.850310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10193e6-be50-4861-85cc-7eeb72a335af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:26.851365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10193e6-be50-4861-85cc-7eeb72a335af None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.852048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10193e6-be50-4861-85cc-7eeb72a335af None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.852571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10193e6-be50-4861-85cc-7eeb72a335af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.861747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:26.864826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10193e6-be50-4861-85cc-7eeb72a335af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:26.866551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10193e6-be50-4861-85cc-7eeb72a335af None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b10193e6-be50-4861-85cc-7eeb72a335af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:26.885890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:26.886762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:26.887632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:26.887632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:26.887632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:26.887632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:26.894651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 263/528] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:26.895823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10193e6-be50-4861-85cc-7eeb72a335af None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.957706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 266/529] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:26.958658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596698e-b280-424a-a292-8e69e1978266 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.998482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:27.011906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10193e6-be50-4861-85cc-7eeb72a335af None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.052723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22188-5da0-495d-9a51-bc2de3aec014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.053928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22188-5da0-495d-9a51-bc2de3aec014 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.054409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22188-5da0-495d-9a51-bc2de3aec014 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.054877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22188-5da0-495d-9a51-bc2de3aec014 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.062808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc22188-5da0-495d-9a51-bc2de3aec014 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.064682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc22188-5da0-495d-9a51-bc2de3aec014 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.076006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596698e-b280-424a-a292-8e69e1978266 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-0dc22188-5da0-495d-9a51-bc2de3aec014 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:27.080336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:27.081167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:27.082000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:27.082000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:27.082000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:27.082000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:27.082000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:27.082000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:27.082000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:27.082000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:27.084228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 264/530] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:27.089551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:27.090254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22188-5da0-495d-9a51-bc2de3aec014 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.112022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836977-f58e-46f9-b24f-61016f6fe135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.112776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836977-f58e-46f9-b24f-61016f6fe135 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.112883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836977-f58e-46f9-b24f-61016f6fe135 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.113142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836977-f58e-46f9-b24f-61016f6fe135 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.113851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59836977-f58e-46f9-b24f-61016f6fe135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:27.114157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59836977-f58e-46f9-b24f-61016f6fe135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.115519 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59836977-f58e-46f9-b24f-61016f6fe135 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.130879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 267/531] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:27.130879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836977-f58e-46f9-b24f-61016f6fe135 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.208250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22188-5da0-495d-9a51-bc2de3aec014 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.228085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836977-f58e-46f9-b24f-61016f6fe135 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.245862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4264754-94df-4835-809c-fc747216bca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.246948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4264754-94df-4835-809c-fc747216bca6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.248037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4264754-94df-4835-809c-fc747216bca6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.248610 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4264754-94df-4835-809c-fc747216bca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.261086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4264754-94df-4835-809c-fc747216bca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.262640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31640c-a94a-4bf6-bdf1-2417a0842347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.263698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4264754-94df-4835-809c-fc747216bca6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.263969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31640c-a94a-4bf6-bdf1-2417a0842347 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.264256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31640c-a94a-4bf6-bdf1-2417a0842347 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.264531 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31640c-a94a-4bf6-bdf1-2417a0842347 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.265489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31640c-a94a-4bf6-bdf1-2417a0842347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:27.265797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31640c-a94a-4bf6-bdf1-2417a0842347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.267205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31640c-a94a-4bf6-bdf1-2417a0842347 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.279359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 268/532] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:27.280205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31640c-a94a-4bf6-bdf1-2417a0842347 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-c4264754-94df-4835-809c-fc747216bca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:27.284184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:27.285010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:27.285823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:27.285823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:27.285823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:27.285823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:27.287967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 265/533] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:27.288982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4264754-94df-4835-809c-fc747216bca6 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.293032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:27.316358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:27.390387 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31640c-a94a-4bf6-bdf1-2417a0842347 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.400769 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4264754-94df-4835-809c-fc747216bca6 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.426972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580beab0-9d27-484c-8faa-45e089810d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.427807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580beab0-9d27-484c-8faa-45e089810d93 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.428107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580beab0-9d27-484c-8faa-45e089810d93 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.428352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580beab0-9d27-484c-8faa-45e089810d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.435623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580beab0-9d27-484c-8faa-45e089810d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.437408 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580beab0-9d27-484c-8faa-45e089810d93 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.439518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961606e5-429a-41e9-88d4-b8dc820a11ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.440489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961606e5-429a-41e9-88d4-b8dc820a11ff None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.440968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961606e5-429a-41e9-88d4-b8dc820a11ff None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.441465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961606e5-429a-41e9-88d4-b8dc820a11ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.442498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961606e5-429a-41e9-88d4-b8dc820a11ff None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=24198f20ebcd4e64a5184fb9fc6764cd) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:27.443011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961606e5-429a-41e9-88d4-b8dc820a11ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.444670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961606e5-429a-41e9-88d4-b8dc820a11ff None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.451364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 266/534] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/role_assignments?user.id=24198f20ebcd4e64a5184fb9fc6764cd&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:27.452414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961606e5-429a-41e9-88d4-b8dc820a11ff None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-580beab0-9d27-484c-8faa-45e089810d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:27.452520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:27.461138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 269/535] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:27.463438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580beab0-9d27-484c-8faa-45e089810d93 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.545254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:27.581373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961606e5-429a-41e9-88d4-b8dc820a11ff None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.597412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:27.614180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580beab0-9d27-484c-8faa-45e089810d93 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.629481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3733-6b50-4fdb-a857-86f0364a8729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.630554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3733-6b50-4fdb-a857-86f0364a8729 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.631041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3733-6b50-4fdb-a857-86f0364a8729 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.631835 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3733-6b50-4fdb-a857-86f0364a8729 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.633655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3733-6b50-4fdb-a857-86f0364a8729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:27.634188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3733-6b50-4fdb-a857-86f0364a8729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.635838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3733-6b50-4fdb-a857-86f0364a8729 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.650307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 267/536] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:27.656572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3733-6b50-4fdb-a857-86f0364a8729 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.674557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d723c98-209f-407d-9786-7f6f96a06b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.675759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d723c98-209f-407d-9786-7f6f96a06b4a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.676347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d723c98-209f-407d-9786-7f6f96a06b4a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.676642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d723c98-209f-407d-9786-7f6f96a06b4a None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.677704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d723c98-209f-407d-9786-7f6f96a06b4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:27.678019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d723c98-209f-407d-9786-7f6f96a06b4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.679905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d723c98-209f-407d-9786-7f6f96a06b4a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.698282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 270/537] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:27.704275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d723c98-209f-407d-9786-7f6f96a06b4a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.771789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3733-6b50-4fdb-a857-86f0364a8729 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.800002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:27.812382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1943f-5f06-409d-8297-03b731746a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.814654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1943f-5f06-409d-8297-03b731746a45 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.815881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1943f-5f06-409d-8297-03b731746a45 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.816339 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1943f-5f06-409d-8297-03b731746a45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.828976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1943f-5f06-409d-8297-03b731746a45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.830572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1943f-5f06-409d-8297-03b731746a45 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-04f1943f-5f06-409d-8297-03b731746a45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:27.861205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:27.862189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:27.863004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:27.863004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:27.863004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:27.863004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:27.863004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:27.863004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:27.863004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:27.863004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:27.866584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 268/538] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:27.872794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1943f-5f06-409d-8297-03b731746a45 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.906457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d723c98-209f-407d-9786-7f6f96a06b4a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.982442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e550ec7-ac1e-465c-8869-1df88bc5d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.984328 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e550ec7-ac1e-465c-8869-1df88bc5d183 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.984609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e550ec7-ac1e-465c-8869-1df88bc5d183 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.984883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e550ec7-ac1e-465c-8869-1df88bc5d183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.985709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e550ec7-ac1e-465c-8869-1df88bc5d183 None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=20b4902b340a4260a0b5f716c3ae9acf) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:27.986019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e550ec7-ac1e-465c-8869-1df88bc5d183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.988234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e550ec7-ac1e-465c-8869-1df88bc5d183 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:28.000697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 271/539] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/role_assignments?user.id=20b4902b340a4260a0b5f716c3ae9acf&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:28.048434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1943f-5f06-409d-8297-03b731746a45 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:28.111486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b5902-a6f9-47e3-95b1-5e140809af65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:28.112199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b5902-a6f9-47e3-95b1-5e140809af65 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:28.112483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b5902-a6f9-47e3-95b1-5e140809af65 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:28.112760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b5902-a6f9-47e3-95b1-5e140809af65 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:28.113571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b5902-a6f9-47e3-95b1-5e140809af65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:28.113881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b5902-a6f9-47e3-95b1-5e140809af65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:28.115387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b5902-a6f9-47e3-95b1-5e140809af65 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:28.143495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 269/540] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:28.149090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e550ec7-ac1e-465c-8869-1df88bc5d183 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:28.175390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:28.274520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e550ec7-ac1e-465c-8869-1df88bc5d183 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:28.317227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd75f7-464a-46a3-9581-f7f96cf04570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:28.317889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd75f7-464a-46a3-9581-f7f96cf04570 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:28.318167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd75f7-464a-46a3-9581-f7f96cf04570 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:28.318440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd75f7-464a-46a3-9581-f7f96cf04570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:28.319323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd75f7-464a-46a3-9581-f7f96cf04570 None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=7973be0cfa9846afaef91c7ae1b190d2) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:28.319636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd75f7-464a-46a3-9581-f7f96cf04570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:28.321108 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd75f7-464a-46a3-9581-f7f96cf04570 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:28.330852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 272/541] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:28 2022] GET /identity/v3/role_assignments?user.id=7973be0cfa9846afaef91c7ae1b190d2&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:28.627418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942810-64c1-44fd-90af-92f5e56c4d3e None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:28.627849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942810-64c1-44fd-90af-92f5e56c4d3e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:28.628024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942810-64c1-44fd-90af-92f5e56c4d3e None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:28.629688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 270/542] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:28.635308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3372383-e286-4397-a5ab-7e696906d17c None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:28.635599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3372383-e286-4397-a5ab-7e696906d17c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:28.635911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3372383-e286-4397-a5ab-7e696906d17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:28.656200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b3372383-e286-4397-a5ab-7e696906d17c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:28.657703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b3372383-e286-4397-a5ab-7e696906d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:28.731101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 273/543] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:28.767418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942810-64c1-44fd-90af-92f5e56c4d3e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:28.846978 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:28.878927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317e515-b072-49db-a1f7-5b2905431c6b None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:28.879204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317e515-b072-49db-a1f7-5b2905431c6b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:28.879408 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317e515-b072-49db-a1f7-5b2905431c6b None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:28.881091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 274/544] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:28.886383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98315e-0ba9-4570-b605-64ca34d0da75 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:28.886679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98315e-0ba9-4570-b605-64ca34d0da75 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:28.886964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98315e-0ba9-4570-b605-64ca34d0da75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:28.905392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-1a98315e-0ba9-4570-b605-64ca34d0da75 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:28.906584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1a98315e-0ba9-4570-b605-64ca34d0da75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:28.909534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:28.923089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942810-64c1-44fd-90af-92f5e56c4d3e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:28.979712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad1be4-6fb4-447b-9021-2797a8b0377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:28.980697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad1be4-6fb4-447b-9021-2797a8b0377e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:28.980981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad1be4-6fb4-447b-9021-2797a8b0377e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:28.981255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad1be4-6fb4-447b-9021-2797a8b0377e None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:28.993002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad1be4-6fb4-447b-9021-2797a8b0377e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-1cad1be4-6fb4-447b-9021-2797a8b0377e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:29.001929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:29.002796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:29.003588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 271/545] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:29.013592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad1be4-6fb4-447b-9021-2797a8b0377e None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:29.015813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 275/546] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:29.044892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98315e-0ba9-4570-b605-64ca34d0da75 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:29.172136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad1be4-6fb4-447b-9021-2797a8b0377e None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:29.191720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:29.231194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98315e-0ba9-4570-b605-64ca34d0da75 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:29.248554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993b616-70ac-45df-8689-e1160b4f0118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:29.249478 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993b616-70ac-45df-8689-e1160b4f0118 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:29.249959 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993b616-70ac-45df-8689-e1160b4f0118 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:29.250429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993b616-70ac-45df-8689-e1160b4f0118 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.251370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993b616-70ac-45df-8689-e1160b4f0118 None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:29.251957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993b616-70ac-45df-8689-e1160b4f0118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:29.253597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993b616-70ac-45df-8689-e1160b4f0118 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:29.282330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 272/547] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:29.283579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993b616-70ac-45df-8689-e1160b4f0118 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:29.300530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5caeab-1113-438c-896e-7e668bfa84dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:29.301917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5caeab-1113-438c-896e-7e668bfa84dd None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:29.302642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5caeab-1113-438c-896e-7e668bfa84dd None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:29.303496 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5caeab-1113-438c-896e-7e668bfa84dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.324054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:29.332320 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5caeab-1113-438c-896e-7e668bfa84dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-cb5caeab-1113-438c-896e-7e668bfa84dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:29.344735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:29.345741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:29.346563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:29.347661 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 276/548] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:29.356537 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5caeab-1113-438c-896e-7e668bfa84dd None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:29.435602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993b616-70ac-45df-8689-e1160b4f0118 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:29.475843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e136-ea59-4c99-ae10-7d7c3436f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:29.476892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e136-ea59-4c99-ae10-7d7c3436f424 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:29.477180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e136-ea59-4c99-ae10-7d7c3436f424 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:29.477461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e136-ea59-4c99-ae10-7d7c3436f424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.506096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541e136-ea59-4c99-ae10-7d7c3436f424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:29.507856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541e136-ea59-4c99-ae10-7d7c3436f424 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-5541e136-ea59-4c99-ae10-7d7c3436f424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:29.536746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:29.537735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:29.538594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:29.538594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:29.538594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:29.538594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:29.546061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 273/549] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:29.546901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e136-ea59-4c99-ae10-7d7c3436f424 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:29.553022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5caeab-1113-438c-896e-7e668bfa84dd None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:29.574558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:29.625384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b5d9f-bb43-4a80-ace7-8c91e1ebac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:29.626063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b5d9f-bb43-4a80-ace7-8c91e1ebac88 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:29.626342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b5d9f-bb43-4a80-ace7-8c91e1ebac88 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:29.626611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b5d9f-bb43-4a80-ace7-8c91e1ebac88 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.627356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b5d9f-bb43-4a80-ace7-8c91e1ebac88 None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:29.627660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b5d9f-bb43-4a80-ace7-8c91e1ebac88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:29.629054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b5d9f-bb43-4a80-ace7-8c91e1ebac88 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:29.644582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 277/550] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:29.650812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b5d9f-bb43-4a80-ace7-8c91e1ebac88 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:29.675244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e136-ea59-4c99-ae10-7d7c3436f424 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:29.749621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd100c51-99f5-445a-ae43-71c65d9e0fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:29.750611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd100c51-99f5-445a-ae43-71c65d9e0fb2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:29.751031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd100c51-99f5-445a-ae43-71c65d9e0fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:29.751452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd100c51-99f5-445a-ae43-71c65d9e0fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.752401 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:29.753252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd100c51-99f5-445a-ae43-71c65d9e0fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:29.753808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd100c51-99f5-445a-ae43-71c65d9e0fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:29.755145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd100c51-99f5-445a-ae43-71c65d9e0fb2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:29.779827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 274/551] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:29.785397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd100c51-99f5-445a-ae43-71c65d9e0fb2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:29.818264 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b5d9f-bb43-4a80-ace7-8c91e1ebac88 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:29.900976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2d0e3-848d-490f-808d-8d6743a65ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:29.901784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2d0e3-848d-490f-808d-8d6743a65ec3 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:29.902064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2d0e3-848d-490f-808d-8d6743a65ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:29.902337 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2d0e3-848d-490f-808d-8d6743a65ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.914235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:29.926279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2d0e3-848d-490f-808d-8d6743a65ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:29.930099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2d0e3-848d-490f-808d-8d6743a65ec3 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:29.953985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd100c51-99f5-445a-ae43-71c65d9e0fb2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-23b2d0e3-848d-490f-808d-8d6743a65ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:29.968555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:29.969424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:29.970277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:29.970277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:29.970277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:29.970277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:29.978008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 278/552] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:29.980469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2d0e3-848d-490f-808d-8d6743a65ec3 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:30.047761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118318fa-e5b9-4198-9394-6b2c053322c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:30.047761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118318fa-e5b9-4198-9394-6b2c053322c2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.047761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118318fa-e5b9-4198-9394-6b2c053322c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.047761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118318fa-e5b9-4198-9394-6b2c053322c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.052799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118318fa-e5b9-4198-9394-6b2c053322c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:30.054400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118318fa-e5b9-4198-9394-6b2c053322c2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-118318fa-e5b9-4198-9394-6b2c053322c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:30.072503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:30.073564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:30.074448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 275/553] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:30.081351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118318fa-e5b9-4198-9394-6b2c053322c2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:30.166483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2d0e3-848d-490f-808d-8d6743a65ec3 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:30.181622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:30.203829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059099-5c81-4426-adcb-2077a1ad2cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:30.204572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059099-5c81-4426-adcb-2077a1ad2cd9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.204863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059099-5c81-4426-adcb-2077a1ad2cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.205145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059099-5c81-4426-adcb-2077a1ad2cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.205920 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d059099-5c81-4426-adcb-2077a1ad2cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:30.206237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d059099-5c81-4426-adcb-2077a1ad2cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:30.207666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d059099-5c81-4426-adcb-2077a1ad2cd9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:30.212149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118318fa-e5b9-4198-9394-6b2c053322c2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:30.223796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 279/554] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:30.225148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6330e-e6e5-480c-9054-6ad60a4b3fc1 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.225442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6330e-e6e5-480c-9054-6ad60a4b3fc1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.225729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6330e-e6e5-480c-9054-6ad60a4b3fc1 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.228479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 280/555] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:30.229244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6330e-e6e5-480c-9054-6ad60a4b3fc1 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:30.252599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2224d86-0c8e-4ad0-b9da-67a2d8a34e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:30.253273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2224d86-0c8e-4ad0-b9da-67a2d8a34e9c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.253542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2224d86-0c8e-4ad0-b9da-67a2d8a34e9c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.253815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2224d86-0c8e-4ad0-b9da-67a2d8a34e9c None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.254658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2224d86-0c8e-4ad0-b9da-67a2d8a34e9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:30.254970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2224d86-0c8e-4ad0-b9da-67a2d8a34e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:30.256749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2224d86-0c8e-4ad0-b9da-67a2d8a34e9c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:30.271720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:30.276663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 276/556] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 16 00:20:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:30.278241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d16c9-8a1f-4016-bf5f-cde7ad4a73b4 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.278740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d16c9-8a1f-4016-bf5f-cde7ad4a73b4 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.279217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d16c9-8a1f-4016-bf5f-cde7ad4a73b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.296580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-742d16c9-8a1f-4016-bf5f-cde7ad4a73b4 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:30.298098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-742d16c9-8a1f-4016-bf5f-cde7ad4a73b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:30.342449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6330e-e6e5-480c-9054-6ad60a4b3fc1 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:30.375755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 277/557] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:30.376980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d16c9-8a1f-4016-bf5f-cde7ad4a73b4 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:30.381219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8604d9-f2de-41d0-a752-971a7b329f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:30.381386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8604d9-f2de-41d0-a752-971a7b329f7b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.381926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8604d9-f2de-41d0-a752-971a7b329f7b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.382204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8604d9-f2de-41d0-a752-971a7b329f7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.391751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8604d9-f2de-41d0-a752-971a7b329f7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:30.391751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8604d9-f2de-41d0-a752-971a7b329f7b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-8a8604d9-f2de-41d0-a752-971a7b329f7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:30.411779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:30.413204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:30.414114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 281/558] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 16 00:20:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:30.415341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8604d9-f2de-41d0-a752-971a7b329f7b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:30.452890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:30.511011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d16c9-8a1f-4016-bf5f-cde7ad4a73b4 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:30.527213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8604d9-f2de-41d0-a752-971a7b329f7b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:30.543421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:30.553247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480608b3-bf66-449a-8716-60e9e6d8b75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:30.553247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480608b3-bf66-449a-8716-60e9e6d8b75c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.553247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480608b3-bf66-449a-8716-60e9e6d8b75c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.553247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480608b3-bf66-449a-8716-60e9e6d8b75c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.565543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e8062-8b37-48da-886e-a3389d9b4cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:30.566214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8062-8b37-48da-886e-a3389d9b4cd5 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.566502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8062-8b37-48da-886e-a3389d9b4cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.566778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8062-8b37-48da-886e-a3389d9b4cd5 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.567606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e8062-8b37-48da-886e-a3389d9b4cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:30.567945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e8062-8b37-48da-886e-a3389d9b4cd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:30.569457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e8062-8b37-48da-886e-a3389d9b4cd5 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:30.607503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 282/559] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 16 00:20:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:30.608640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e8062-8b37-48da-886e-a3389d9b4cd5 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:30.627335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480608b3-bf66-449a-8716-60e9e6d8b75c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:30.628845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480608b3-bf66-449a-8716-60e9e6d8b75c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:30.705464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:30.714819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e8062-8b37-48da-886e-a3389d9b4cd5 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:30.733293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 278/560] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:30.734630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd327-3ceb-4655-a179-314cdea59152 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.735107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd327-3ceb-4655-a179-314cdea59152 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.735398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd327-3ceb-4655-a179-314cdea59152 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.740853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 279/561] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:30.740853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fd327-3ceb-4655-a179-314cdea59152 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:30.760261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f77e-c664-4ba5-84f2-4d6f9f49d141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:30.761374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f77e-c664-4ba5-84f2-4d6f9f49d141 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.761659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f77e-c664-4ba5-84f2-4d6f9f49d141 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.761968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f77e-c664-4ba5-84f2-4d6f9f49d141 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.775144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589f77e-c664-4ba5-84f2-4d6f9f49d141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:30.775358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-b589f77e-c664-4ba5-84f2-4d6f9f49d141 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:30.783794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:30.784756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:30.785594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 283/562] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:30.786831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f77e-c664-4ba5-84f2-4d6f9f49d141 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:30.894694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fd327-3ceb-4655-a179-314cdea59152 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:30.928258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f77e-c664-4ba5-84f2-4d6f9f49d141 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:30.929054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50bdd2-9da4-4513-97a2-5bba7d787705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:30.929838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50bdd2-9da4-4513-97a2-5bba7d787705 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.930117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50bdd2-9da4-4513-97a2-5bba7d787705 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.930391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50bdd2-9da4-4513-97a2-5bba7d787705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.940462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50bdd2-9da4-4513-97a2-5bba7d787705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:30.941926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50bdd2-9da4-4513-97a2-5bba7d787705 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-6e50bdd2-9da4-4513-97a2-5bba7d787705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:30.958778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:30.959864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:30.960789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:30.960789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:30.960789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:30.960789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:30.960789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 280/563] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:30.961117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58560786-5b92-4c50-b97d-9982209d9b89 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.961399 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58560786-5b92-4c50-b97d-9982209d9b89 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.961678 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58560786-5b92-4c50-b97d-9982209d9b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.963676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8719927-69fc-4e92-b8ab-2c72bb219995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:30.964499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8719927-69fc-4e92-b8ab-2c72bb219995 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:30.964782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8719927-69fc-4e92-b8ab-2c72bb219995 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:30.965056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8719927-69fc-4e92-b8ab-2c72bb219995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:30.977357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8719927-69fc-4e92-b8ab-2c72bb219995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:30.977839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-58560786-5b92-4c50-b97d-9982209d9b89 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:30.978796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8719927-69fc-4e92-b8ab-2c72bb219995 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:30.979026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-58560786-5b92-4c50-b97d-9982209d9b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-b8719927-69fc-4e92-b8ab-2c72bb219995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:30.995928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:30.996981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:30.998071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:30.998071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:30.998071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:30.998071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:30.998071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 284/564] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:30.998071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8719927-69fc-4e92-b8ab-2c72bb219995 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.002479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:31.049541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 281/565] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:31.050998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47b06c-48d1-4a19-b68e-960e9eebd226 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.051292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47b06c-48d1-4a19-b68e-960e9eebd226 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.051564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47b06c-48d1-4a19-b68e-960e9eebd226 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.053122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 282/566] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:31.053824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47b06c-48d1-4a19-b68e-960e9eebd226 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.070294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:31.103363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8719927-69fc-4e92-b8ab-2c72bb219995 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.135529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187b125-5eb5-4819-a320-ee8ffe599526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.136212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187b125-5eb5-4819-a320-ee8ffe599526 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.136500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187b125-5eb5-4819-a320-ee8ffe599526 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.136775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187b125-5eb5-4819-a320-ee8ffe599526 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.137502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187b125-5eb5-4819-a320-ee8ffe599526 None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:31.138321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187b125-5eb5-4819-a320-ee8ffe599526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.139683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187b125-5eb5-4819-a320-ee8ffe599526 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.147335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 285/567] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:31.148076 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187b125-5eb5-4819-a320-ee8ffe599526 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.163326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47b06c-48d1-4a19-b68e-960e9eebd226 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.197392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72737119-c677-4d22-86c8-296a321d4ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.198049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737119-c677-4d22-86c8-296a321d4ed9 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.198329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737119-c677-4d22-86c8-296a321d4ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.198604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737119-c677-4d22-86c8-296a321d4ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.199309 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737119-c677-4d22-86c8-296a321d4ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:31.199614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737119-c677-4d22-86c8-296a321d4ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.201531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737119-c677-4d22-86c8-296a321d4ed9 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.212307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 283/568] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:31.213468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ac6bd-4979-418e-8d34-9f912e385ba8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.213759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ac6bd-4979-418e-8d34-9f912e385ba8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.214040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ac6bd-4979-418e-8d34-9f912e385ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.218140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:31.231878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-814ac6bd-4979-418e-8d34-9f912e385ba8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:31.233181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-814ac6bd-4979-418e-8d34-9f912e385ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:31.246175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187b125-5eb5-4819-a320-ee8ffe599526 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.280527 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6921bed-7b5c-4c14-901f-73fb2edd7dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.281176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6921bed-7b5c-4c14-901f-73fb2edd7dbf None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.281456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6921bed-7b5c-4c14-901f-73fb2edd7dbf None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.281731 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6921bed-7b5c-4c14-901f-73fb2edd7dbf None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.282429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6921bed-7b5c-4c14-901f-73fb2edd7dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:31.282752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6921bed-7b5c-4c14-901f-73fb2edd7dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.284151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6921bed-7b5c-4c14-901f-73fb2edd7dbf None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.296645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 286/569] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:31.297409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6921bed-7b5c-4c14-901f-73fb2edd7dbf None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.305846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 284/570] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:31.305846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ac6bd-4979-418e-8d34-9f912e385ba8 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.305846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:31.395031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ac6bd-4979-418e-8d34-9f912e385ba8 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.401802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6921bed-7b5c-4c14-901f-73fb2edd7dbf None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.426595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:31.428886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ff6c-3552-4eea-ac54-2286efe79394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.429673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ff6c-3552-4eea-ac54-2286efe79394 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.429959 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ff6c-3552-4eea-ac54-2286efe79394 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.430234 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ff6c-3552-4eea-ac54-2286efe79394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.435375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e713a-a8b4-4f22-b854-73c1b23b607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.436192 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e713a-a8b4-4f22-b854-73c1b23b607d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.436475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e713a-a8b4-4f22-b854-73c1b23b607d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.436746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e713a-a8b4-4f22-b854-73c1b23b607d None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.440645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9ff6c-3552-4eea-ac54-2286efe79394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.442083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9ff6c-3552-4eea-ac54-2286efe79394 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.446401 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e713a-a8b4-4f22-b854-73c1b23b607d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-5d2e713a-a8b4-4f22-b854-73c1b23b607d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:31.454535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:31.455425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 287/571] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:31.456560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e713a-a8b4-4f22-b854-73c1b23b607d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-63c9ff6c-3552-4eea-ac54-2286efe79394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:31.459681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:31.460872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:31.462063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:31.462063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:31.462063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:31.462063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:31.462063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 285/572] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:31.462063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ff6c-3552-4eea-ac54-2286efe79394 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.518277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:31.560367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ff6c-3552-4eea-ac54-2286efe79394 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.562000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e713a-a8b4-4f22-b854-73c1b23b607d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.593797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379003ed-4211-4193-b83d-efbeeb6ee132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.594570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379003ed-4211-4193-b83d-efbeeb6ee132 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.594849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379003ed-4211-4193-b83d-efbeeb6ee132 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.594944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b933-e63a-41a1-9935-b3d1fd457b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.595123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379003ed-4211-4193-b83d-efbeeb6ee132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.595671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b933-e63a-41a1-9935-b3d1fd457b20 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.595984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b933-e63a-41a1-9935-b3d1fd457b20 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.596265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b933-e63a-41a1-9935-b3d1fd457b20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.601766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379003ed-4211-4193-b83d-efbeeb6ee132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.602731 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4b933-e63a-41a1-9935-b3d1fd457b20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.603214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379003ed-4211-4193-b83d-efbeeb6ee132 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.604180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4b933-e63a-41a1-9935-b3d1fd457b20 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-379003ed-4211-4193-b83d-efbeeb6ee132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:31.616639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:31.617519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:31.618418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:31.618418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:31.618418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:31.618418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:31.618418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:31.618418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:31.618418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:31.618418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:31.618418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 286/573] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-25f4b933-e63a-41a1-9935-b3d1fd457b20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:31.618892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:31.619675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:31.621456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:31.621456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:31.621456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:31.621456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:31.621456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:31.621456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:31.621456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:31.621456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:31.622516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379003ed-4211-4193-b83d-efbeeb6ee132 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.622609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 288/574] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:31.622609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b933-e63a-41a1-9935-b3d1fd457b20 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.668030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:31.718102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b933-e63a-41a1-9935-b3d1fd457b20 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.718633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379003ed-4211-4193-b83d-efbeeb6ee132 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.732269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:31.751043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61454f0-1c46-4cc8-815d-82131a396ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.751431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186800b0-e04c-4f8c-b6b7-f521e675c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.751700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61454f0-1c46-4cc8-815d-82131a396ee8 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.752011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61454f0-1c46-4cc8-815d-82131a396ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.752265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186800b0-e04c-4f8c-b6b7-f521e675c645 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.753724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61454f0-1c46-4cc8-815d-82131a396ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.753811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186800b0-e04c-4f8c-b6b7-f521e675c645 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.753811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186800b0-e04c-4f8c-b6b7-f521e675c645 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.753931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61454f0-1c46-4cc8-815d-82131a396ee8 None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:31.753931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61454f0-1c46-4cc8-815d-82131a396ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.754723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61454f0-1c46-4cc8-815d-82131a396ee8 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.763388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 289/575] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:31.763862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186800b0-e04c-4f8c-b6b7-f521e675c645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:31.764182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61454f0-1c46-4cc8-815d-82131a396ee8 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-186800b0-e04c-4f8c-b6b7-f521e675c645 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:31.771913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:31.773024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 287/576] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:31.774172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186800b0-e04c-4f8c-b6b7-f521e675c645 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.945446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186800b0-e04c-4f8c-b6b7-f521e675c645 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.946058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61454f0-1c46-4cc8-815d-82131a396ee8 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.954517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:31.977416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c04cfb-5965-403d-ad95-adafc9e977c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.978484 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c04cfb-5965-403d-ad95-adafc9e977c2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.978766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c04cfb-5965-403d-ad95-adafc9e977c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.979042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c04cfb-5965-403d-ad95-adafc9e977c2 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.979925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c04cfb-5965-403d-ad95-adafc9e977c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:31.980125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c2f2-9389-43ff-9089-4869e2d23ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.980404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c04cfb-5965-403d-ad95-adafc9e977c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.980782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c2f2-9389-43ff-9089-4869e2d23ea7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.981066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c2f2-9389-43ff-9089-4869e2d23ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.981835 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c2f2-9389-43ff-9089-4869e2d23ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.982543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192c2f2-9389-43ff-9089-4869e2d23ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:31.982849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192c2f2-9389-43ff-9089-4869e2d23ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.983467 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c04cfb-5965-403d-ad95-adafc9e977c2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.984269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192c2f2-9389-43ff-9089-4869e2d23ea7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.995656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 288/577] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:32.001187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 290/578] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:32.001370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c04cfb-5965-403d-ad95-adafc9e977c2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.001471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c2f2-9389-43ff-9089-4869e2d23ea7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.033424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:32.098085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c04cfb-5965-403d-ad95-adafc9e977c2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.098720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c2f2-9389-43ff-9089-4869e2d23ea7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.131808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61d295-c456-4857-9886-ecdeaa24637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61d295-c456-4857-9886-ecdeaa24637c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.132765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61d295-c456-4857-9886-ecdeaa24637c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.132886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e1858-c761-4b3f-b361-ed5daff08eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.133039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61d295-c456-4857-9886-ecdeaa24637c None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.133596 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e1858-c761-4b3f-b361-ed5daff08eb0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.133807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61d295-c456-4857-9886-ecdeaa24637c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:32.133896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e1858-c761-4b3f-b361-ed5daff08eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.134115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61d295-c456-4857-9886-ecdeaa24637c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.134206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e1858-c761-4b3f-b361-ed5daff08eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.135547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61d295-c456-4857-9886-ecdeaa24637c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.144017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e1858-c761-4b3f-b361-ed5daff08eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.145606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e1858-c761-4b3f-b361-ed5daff08eb0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.147100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 289/579] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:32.147909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61d295-c456-4857-9886-ecdeaa24637c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-4c8e1858-c761-4b3f-b361-ed5daff08eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:32.163862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:32.164750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:32.165611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:32.165611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:32.165611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:32.165611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:32.165611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 291/580] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:32.165890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e1858-c761-4b3f-b361-ed5daff08eb0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.186580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:32.244464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:32.250889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61d295-c456-4857-9886-ecdeaa24637c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.261871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e1858-c761-4b3f-b361-ed5daff08eb0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.283996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e71c-2853-43c1-9e32-67048fdc88e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.284654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e71c-2853-43c1-9e32-67048fdc88e4 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.284935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e71c-2853-43c1-9e32-67048fdc88e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.285209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e71c-2853-43c1-9e32-67048fdc88e4 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.285941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7e71c-2853-43c1-9e32-67048fdc88e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:32.286246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7e71c-2853-43c1-9e32-67048fdc88e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.287613 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7e71c-2853-43c1-9e32-67048fdc88e4 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.295765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 290/581] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:32.296295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b408e-9e11-465c-b38c-6b751ef04b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.296538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e71c-2853-43c1-9e32-67048fdc88e4 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.296943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b408e-9e11-465c-b38c-6b751ef04b1c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.297228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b408e-9e11-465c-b38c-6b751ef04b1c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.297497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b408e-9e11-465c-b38c-6b751ef04b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.298321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b408e-9e11-465c-b38c-6b751ef04b1c None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=e7ccca2836bc4004bcf39a3070b6c54f) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:32.298627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b408e-9e11-465c-b38c-6b751ef04b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.300065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b408e-9e11-465c-b38c-6b751ef04b1c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.305855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 292/582] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:32 2022] GET /identity/v3/role_assignments?user.id=e7ccca2836bc4004bcf39a3070b6c54f&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:32.306604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b408e-9e11-465c-b38c-6b751ef04b1c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.400632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:32.407307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e71c-2853-43c1-9e32-67048fdc88e4 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.418284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b408e-9e11-465c-b38c-6b751ef04b1c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.450742 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbed4dd-8c96-466a-ad78-6f218a1bbc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.451666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbed4dd-8c96-466a-ad78-6f218a1bbc97 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.452148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbed4dd-8c96-466a-ad78-6f218a1bbc97 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.452344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbed4dd-8c96-466a-ad78-6f218a1bbc97 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.459609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a827f6c-f728-40fb-9e1f-888f5431a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.460535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a827f6c-f728-40fb-9e1f-888f5431a652 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.460819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a827f6c-f728-40fb-9e1f-888f5431a652 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.461004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbed4dd-8c96-466a-ad78-6f218a1bbc97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.461103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a827f6c-f728-40fb-9e1f-888f5431a652 None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/ba29f9c029fe4390af3b6ce1b2147ce9/roles/ef759eb79f6242fbbc2ec11a7807ad23` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.462466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbed4dd-8c96-466a-ad78-6f218a1bbc97 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.476449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a827f6c-f728-40fb-9e1f-888f5431a652 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=ba29f9c029fe4390af3b6ce1b2147ce9, role_id=ef759eb79f6242fbbc2ec11a7807ad23)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.477887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a827f6c-f728-40fb-9e1f-888f5431a652 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-edbed4dd-8c96-466a-ad78-6f218a1bbc97 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:32.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:32.481989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:32.483030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 291/583] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:32.484328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbed4dd-8c96-466a-ad78-6f218a1bbc97 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.506004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:32.558180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 293/584] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:20:32 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/ba29f9c029fe4390af3b6ce1b2147ce9/roles/ef759eb79f6242fbbc2ec11a7807ad23 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:32.559167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a827f6c-f728-40fb-9e1f-888f5431a652 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.587042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbed4dd-8c96-466a-ad78-6f218a1bbc97 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.630198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d31e23-116c-4f5e-89fd-cf0a8a120efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.632077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31e23-116c-4f5e-89fd-cf0a8a120efd None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.632679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31e23-116c-4f5e-89fd-cf0a8a120efd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.633137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31e23-116c-4f5e-89fd-cf0a8a120efd None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.634251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d31e23-116c-4f5e-89fd-cf0a8a120efd None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:32.634750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d31e23-116c-4f5e-89fd-cf0a8a120efd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.637270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d31e23-116c-4f5e-89fd-cf0a8a120efd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.656188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 292/585] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:32.657930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d31e23-116c-4f5e-89fd-cf0a8a120efd None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.706325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a827f6c-f728-40fb-9e1f-888f5431a652 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.750086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af438d28-e11d-4439-bc60-33112ae20062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.751143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af438d28-e11d-4439-bc60-33112ae20062 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.751430 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af438d28-e11d-4439-bc60-33112ae20062 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.751709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af438d28-e11d-4439-bc60-33112ae20062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.755373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:32.768802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:32.768974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af438d28-e11d-4439-bc60-33112ae20062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.768974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af438d28-e11d-4439-bc60-33112ae20062 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.788615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d31e23-116c-4f5e-89fd-cf0a8a120efd None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-af438d28-e11d-4439-bc60-33112ae20062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:32.790543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:32.791595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:32.792725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:32.792725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:32.792725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:32.792725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:32.795785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 294/586] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:32.796898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af438d28-e11d-4439-bc60-33112ae20062 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.840265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68926c44-b49d-436f-b384-4669d2bb6666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.841589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68926c44-b49d-436f-b384-4669d2bb6666 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.841954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68926c44-b49d-436f-b384-4669d2bb6666 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.842304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68926c44-b49d-436f-b384-4669d2bb6666 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.843267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68926c44-b49d-436f-b384-4669d2bb6666 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:32.843657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68926c44-b49d-436f-b384-4669d2bb6666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.845781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68926c44-b49d-436f-b384-4669d2bb6666 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.869836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 293/587] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 16 00:20:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:32.870717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68926c44-b49d-436f-b384-4669d2bb6666 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.917957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af438d28-e11d-4439-bc60-33112ae20062 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.964134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1a845-d81c-49e0-9548-d389a6833179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.965192 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a845-d81c-49e0-9548-d389a6833179 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.965501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a845-d81c-49e0-9548-d389a6833179 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.966273 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1a845-d81c-49e0-9548-d389a6833179 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.976789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1a845-d81c-49e0-9548-d389a6833179 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.978552 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1a845-d81c-49e0-9548-d389a6833179 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.989559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68926c44-b49d-436f-b384-4669d2bb6666 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-1bf1a845-d81c-49e0-9548-d389a6833179 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:33.000951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:33.002084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:20:33.003095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:33.010814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 295/588] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:33.010814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1a845-d81c-49e0-9548-d389a6833179 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.035606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8943a-c822-4763-8b76-e66697c242f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.036241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8943a-c822-4763-8b76-e66697c242f1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.036522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8943a-c822-4763-8b76-e66697c242f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.036902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8943a-c822-4763-8b76-e66697c242f1 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.038142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8943a-c822-4763-8b76-e66697c242f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:33.038142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8943a-c822-4763-8b76-e66697c242f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.041695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8943a-c822-4763-8b76-e66697c242f1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.043477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:33.060209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 294/589] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:33.061156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8943a-c822-4763-8b76-e66697c242f1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.067930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:33.125328 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1a845-d81c-49e0-9548-d389a6833179 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.161992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ee10a-454e-462f-999f-c75d99e6c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.163038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ee10a-454e-462f-999f-c75d99e6c212 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.163423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ee10a-454e-462f-999f-c75d99e6c212 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.163845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ee10a-454e-462f-999f-c75d99e6c212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.175388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ee10a-454e-462f-999f-c75d99e6c212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.177158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ee10a-454e-462f-999f-c75d99e6c212 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.190287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8943a-c822-4763-8b76-e66697c242f1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-146ee10a-454e-462f-999f-c75d99e6c212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:33.196208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:33.197258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:33.198196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:33.198196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:33.198196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:33.198196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:33.203670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 296/590] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:33.203670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ee10a-454e-462f-999f-c75d99e6c212 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.239473 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14ea93-e560-4a3d-b855-d41591247403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.241311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14ea93-e560-4a3d-b855-d41591247403 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.241914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14ea93-e560-4a3d-b855-d41591247403 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.242367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14ea93-e560-4a3d-b855-d41591247403 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.243367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14ea93-e560-4a3d-b855-d41591247403 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:33.243893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14ea93-e560-4a3d-b855-d41591247403 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.246017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14ea93-e560-4a3d-b855-d41591247403 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.273134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 295/591] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:33.274364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14ea93-e560-4a3d-b855-d41591247403 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.314020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:33.318473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ee10a-454e-462f-999f-c75d99e6c212 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.342900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:33.357370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2341-5bc2-4b10-a72e-08affa5bc183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.358241 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2341-5bc2-4b10-a72e-08affa5bc183 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.358566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2341-5bc2-4b10-a72e-08affa5bc183 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.359016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2341-5bc2-4b10-a72e-08affa5bc183 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.368878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b2341-5bc2-4b10-a72e-08affa5bc183 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.370779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b2341-5bc2-4b10-a72e-08affa5bc183 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-ac7b2341-5bc2-4b10-a72e-08affa5bc183 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:33.390984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:33.392275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:33.393201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 297/592] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:33.393780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2341-5bc2-4b10-a72e-08affa5bc183 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.405042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14ea93-e560-4a3d-b855-d41591247403 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.443615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0d76a-620c-4dce-9da4-f679d5d18075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.444468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0d76a-620c-4dce-9da4-f679d5d18075 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.444653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0d76a-620c-4dce-9da4-f679d5d18075 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.444906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0d76a-620c-4dce-9da4-f679d5d18075 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.445856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0d76a-620c-4dce-9da4-f679d5d18075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:33.446172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0d76a-620c-4dce-9da4-f679d5d18075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.447602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0d76a-620c-4dce-9da4-f679d5d18075 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.463582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 296/593] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:33.463582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0d76a-620c-4dce-9da4-f679d5d18075 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.515002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2341-5bc2-4b10-a72e-08affa5bc183 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.555032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4c386-ef4b-4548-a263-4508024f3493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.556488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4c386-ef4b-4548-a263-4508024f3493 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.557177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4c386-ef4b-4548-a263-4508024f3493 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.557626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4c386-ef4b-4548-a263-4508024f3493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.568470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0d76a-620c-4dce-9da4-f679d5d18075 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.572128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4c386-ef4b-4548-a263-4508024f3493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.573714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4c386-ef4b-4548-a263-4508024f3493 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.581544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-fab4c386-ef4b-4548-a263-4508024f3493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:33.595563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:33.596716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:33.597710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:33.597710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:33.597710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:33.597710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:33.597710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 298/594] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:33.597710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4c386-ef4b-4548-a263-4508024f3493 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.606798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dd3a1-915f-4278-bb22-65d5e5916e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.607683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dd3a1-915f-4278-bb22-65d5e5916e3b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.608225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dd3a1-915f-4278-bb22-65d5e5916e3b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.608690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dd3a1-915f-4278-bb22-65d5e5916e3b None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.609753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dd3a1-915f-4278-bb22-65d5e5916e3b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:33.610313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dd3a1-915f-4278-bb22-65d5e5916e3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.611673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:33.612925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dd3a1-915f-4278-bb22-65d5e5916e3b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.632961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 297/595] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:33.634061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dd3a1-915f-4278-bb22-65d5e5916e3b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.711880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4c386-ef4b-4548-a263-4508024f3493 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.755197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360dda5-f405-46ed-9f33-3ed2c668e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.755918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dd3a1-915f-4278-bb22-65d5e5916e3b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.756040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360dda5-f405-46ed-9f33-3ed2c668e835 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.756294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360dda5-f405-46ed-9f33-3ed2c668e835 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.756822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360dda5-f405-46ed-9f33-3ed2c668e835 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.769074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360dda5-f405-46ed-9f33-3ed2c668e835 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.770811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360dda5-f405-46ed-9f33-3ed2c668e835 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e360dda5-f405-46ed-9f33-3ed2c668e835 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:33.789800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:33.790914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:33.791833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:33.791833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:33.791833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:33.791833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:33.791833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:33.791833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:33.791833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:33.791833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:33.795793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 299/596] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:33.796932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360dda5-f405-46ed-9f33-3ed2c668e835 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.801606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541e45-a658-492a-8f9d-0bc5a8b0dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.804403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541e45-a658-492a-8f9d-0bc5a8b0dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.804403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541e45-a658-492a-8f9d-0bc5a8b0dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.804403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541e45-a658-492a-8f9d-0bc5a8b0dcd0 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.804403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a541e45-a658-492a-8f9d-0bc5a8b0dcd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:33.804403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a541e45-a658-492a-8f9d-0bc5a8b0dcd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.805411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a541e45-a658-492a-8f9d-0bc5a8b0dcd0 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.818180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 298/597] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:33.819080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541e45-a658-492a-8f9d-0bc5a8b0dcd0 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.866093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:33.888138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:33.925134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360dda5-f405-46ed-9f33-3ed2c668e835 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.938721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541e45-a658-492a-8f9d-0bc5a8b0dcd0 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.970279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d049f6-9088-4c31-b150-d555e0938b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.972249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d049f6-9088-4c31-b150-d555e0938b02 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.972679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d049f6-9088-4c31-b150-d555e0938b02 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.973096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d049f6-9088-4c31-b150-d555e0938b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.977904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487ef39-d253-4ff1-b55d-8d460e3cea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.978675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487ef39-d253-4ff1-b55d-8d460e3cea99 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.979064 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487ef39-d253-4ff1-b55d-8d460e3cea99 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.979446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487ef39-d253-4ff1-b55d-8d460e3cea99 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.980387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487ef39-d253-4ff1-b55d-8d460e3cea99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:33.980802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487ef39-d253-4ff1-b55d-8d460e3cea99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.982552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487ef39-d253-4ff1-b55d-8d460e3cea99 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.986793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d049f6-9088-4c31-b150-d555e0938b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.988441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d049f6-9088-4c31-b150-d555e0938b02 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:34.007834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 299/598] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:34.007834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487ef39-d253-4ff1-b55d-8d460e3cea99 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-a8d049f6-9088-4c31-b150-d555e0938b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:34.014233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:34.015099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:34.016350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:34.016350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:34.016350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:34.016350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:34.020077 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 300/599] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:34.020903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d049f6-9088-4c31-b150-d555e0938b02 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:34.124452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:34.134930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487ef39-d253-4ff1-b55d-8d460e3cea99 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:34.142103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d049f6-9088-4c31-b150-d555e0938b02 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:34.173204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:34.174976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac9f4f-387a-4ec6-8370-4b4c3273e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:34.175930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac9f4f-387a-4ec6-8370-4b4c3273e51b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.176202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac9f4f-387a-4ec6-8370-4b4c3273e51b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.176623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac9f4f-387a-4ec6-8370-4b4c3273e51b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.186561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac9f4f-387a-4ec6-8370-4b4c3273e51b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:34.191660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a6417-baca-4f99-a595-ccb3a6b518d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:34.191865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac9f4f-387a-4ec6-8370-4b4c3273e51b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:34.191956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a6417-baca-4f99-a595-ccb3a6b518d9 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.191956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a6417-baca-4f99-a595-ccb3a6b518d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.191956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a6417-baca-4f99-a595-ccb3a6b518d9 None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/24198f20ebcd4e64a5184fb9fc6764cd/roles/ef759eb79f6242fbbc2ec11a7807ad23` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.205627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a6417-baca-4f99-a595-ccb3a6b518d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=24198f20ebcd4e64a5184fb9fc6764cd, role_id=ef759eb79f6242fbbc2ec11a7807ad23)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-6cac9f4f-387a-4ec6-8370-4b4c3273e51b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:34.206298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:34.207121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:34.208111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:34.208111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:34.208111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:34.208111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:34.208111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:34.208111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:34.208111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:34.208111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:34.208618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a6417-baca-4f99-a595-ccb3a6b518d9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:34.210389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 300/600] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:34.211177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac9f4f-387a-4ec6-8370-4b4c3273e51b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:34.299766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 301/601] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:20:34 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/24198f20ebcd4e64a5184fb9fc6764cd/roles/ef759eb79f6242fbbc2ec11a7807ad23 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:34.300785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a6417-baca-4f99-a595-ccb3a6b518d9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:34.334759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac9f4f-387a-4ec6-8370-4b4c3273e51b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:34.380056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7a125-a16b-4fb8-9839-1c3dfae187aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:34.381173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7a125-a16b-4fb8-9839-1c3dfae187aa None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.382501 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7a125-a16b-4fb8-9839-1c3dfae187aa None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.383067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7a125-a16b-4fb8-9839-1c3dfae187aa None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.384046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7a125-a16b-4fb8-9839-1c3dfae187aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:34.384571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7a125-a16b-4fb8-9839-1c3dfae187aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:34.386192 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7a125-a16b-4fb8-9839-1c3dfae187aa None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:34.404681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 301/602] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:34.411641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7a125-a16b-4fb8-9839-1c3dfae187aa None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:34.428142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:34.499922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a6417-baca-4f99-a595-ccb3a6b518d9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:34.538308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f3332-76ee-42c8-b247-5081464b2dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:34.539371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f3332-76ee-42c8-b247-5081464b2dc9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.539949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f3332-76ee-42c8-b247-5081464b2dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.540429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f3332-76ee-42c8-b247-5081464b2dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.541415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f3332-76ee-42c8-b247-5081464b2dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:34.541923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f3332-76ee-42c8-b247-5081464b2dc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:34.543565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f3332-76ee-42c8-b247-5081464b2dc9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:34.557111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7a125-a16b-4fb8-9839-1c3dfae187aa None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:34.559087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 302/603] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:34.561291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca85a57-b3da-4fa1-91dc-6953675197b9 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.561580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca85a57-b3da-4fa1-91dc-6953675197b9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.561856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca85a57-b3da-4fa1-91dc-6953675197b9 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.563343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 303/604] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:34.567226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca85a57-b3da-4fa1-91dc-6953675197b9 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:34.600230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6a079-e000-4360-b02d-c14927b2f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:34.601198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a079-e000-4360-b02d-c14927b2f98a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.601486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a079-e000-4360-b02d-c14927b2f98a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.601992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:34.602100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a079-e000-4360-b02d-c14927b2f98a None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.611380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6a079-e000-4360-b02d-c14927b2f98a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:34.613363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6a079-e000-4360-b02d-c14927b2f98a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b9b6a079-e000-4360-b02d-c14927b2f98a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:34.634041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:34.635143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:34.636457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:34.636457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:34.636457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:34.636457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:34.636457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:34.636457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:34.636457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:34.636457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:34.636457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 302/605] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:34.641908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588982c-9ecb-4529-ad12-e5e4e315a537 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.642201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588982c-9ecb-4529-ad12-e5e4e315a537 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.642484 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588982c-9ecb-4529-ad12-e5e4e315a537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.664301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-0588982c-9ecb-4529-ad12-e5e4e315a537 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:34.666202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0588982c-9ecb-4529-ad12-e5e4e315a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:34.692052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca85a57-b3da-4fa1-91dc-6953675197b9 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:34.744670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:34.747674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e7c10-4e65-4144-81f6-eea7e5600567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:34.749149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e7c10-4e65-4144-81f6-eea7e5600567 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.749654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e7c10-4e65-4144-81f6-eea7e5600567 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.750169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e7c10-4e65-4144-81f6-eea7e5600567 None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/20b4902b340a4260a0b5f716c3ae9acf/roles/ef759eb79f6242fbbc2ec11a7807ad23` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.755884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 303/606] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:34.757187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588982c-9ecb-4529-ad12-e5e4e315a537 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:34.769008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e7c10-4e65-4144-81f6-eea7e5600567 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=20b4902b340a4260a0b5f716c3ae9acf, role_id=ef759eb79f6242fbbc2ec11a7807ad23)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:34.771167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e7c10-4e65-4144-81f6-eea7e5600567 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:34.864012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 304/607] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:20:34 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/20b4902b340a4260a0b5f716c3ae9acf/roles/ef759eb79f6242fbbc2ec11a7807ad23 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:34.865032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e7c10-4e65-4144-81f6-eea7e5600567 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:34.868619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588982c-9ecb-4529-ad12-e5e4e315a537 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:34.922907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a4b0d-eb03-4163-8062-140927265315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:34.924017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a4b0d-eb03-4163-8062-140927265315 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.924615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a4b0d-eb03-4163-8062-140927265315 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.925110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a4b0d-eb03-4163-8062-140927265315 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.926136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a4b0d-eb03-4163-8062-140927265315 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:34.927314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a4b0d-eb03-4163-8062-140927265315 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:34.929714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a4b0d-eb03-4163-8062-140927265315 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:34.948311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 304/608] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:34.950750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe124a7-fc5d-4943-b47c-46bca321387b None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:34.951555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe124a7-fc5d-4943-b47c-46bca321387b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:34.952208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe124a7-fc5d-4943-b47c-46bca321387b None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:34.953807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 305/609] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:34.959761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe124a7-fc5d-4943-b47c-46bca321387b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:34.980245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:34.998790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e7c10-4e65-4144-81f6-eea7e5600567 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:35.042782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d3fcb-1932-42c1-b3f0-e4bdd858b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:35.044229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d3fcb-1932-42c1-b3f0-e4bdd858b883 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:35.044229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d3fcb-1932-42c1-b3f0-e4bdd858b883 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:35.044229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d3fcb-1932-42c1-b3f0-e4bdd858b883 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:35.045719 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:35.060126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d3fcb-1932-42c1-b3f0-e4bdd858b883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-468d3fcb-1932-42c1-b3f0-e4bdd858b883 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:35.068374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:35.069463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:35.070295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:35.075802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 305/610] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:35.075802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffade9-0c79-428f-b04c-93ac905e6911 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:35.075802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffade9-0c79-428f-b04c-93ac905e6911 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:35.075802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffade9-0c79-428f-b04c-93ac905e6911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:35.094173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-53ffade9-0c79-428f-b04c-93ac905e6911 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:35.095293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-53ffade9-0c79-428f-b04c-93ac905e6911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:35.099417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe124a7-fc5d-4943-b47c-46bca321387b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:35.144216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587fb21-e5ee-4d10-9652-5e65bee14ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:35.145489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587fb21-e5ee-4d10-9652-5e65bee14ba7 None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:35.146092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587fb21-e5ee-4d10-9652-5e65bee14ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:35.146521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587fb21-e5ee-4d10-9652-5e65bee14ba7 None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/7973be0cfa9846afaef91c7ae1b190d2/roles/ef759eb79f6242fbbc2ec11a7807ad23` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:35.168000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587fb21-e5ee-4d10-9652-5e65bee14ba7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=7973be0cfa9846afaef91c7ae1b190d2, role_id=ef759eb79f6242fbbc2ec11a7807ad23)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:35.169752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587fb21-e5ee-4d10-9652-5e65bee14ba7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:35.169871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 306/611] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:35.170784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffade9-0c79-428f-b04c-93ac905e6911 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:35.250003 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 306/612] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:20:34 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/7973be0cfa9846afaef91c7ae1b190d2/roles/ef759eb79f6242fbbc2ec11a7807ad23 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:35.250832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587fb21-e5ee-4d10-9652-5e65bee14ba7 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:35.282339 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:35.313874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffade9-0c79-428f-b04c-93ac905e6911 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:35.353241 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cb32-8a67-4790-8c37-ba69a17013c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:35.353913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cb32-8a67-4790-8c37-ba69a17013c2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:35.354284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cb32-8a67-4790-8c37-ba69a17013c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:35.354459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cb32-8a67-4790-8c37-ba69a17013c2 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:35.355254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cb32-8a67-4790-8c37-ba69a17013c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:35.355596 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cb32-8a67-4790-8c37-ba69a17013c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:35.357016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cb32-8a67-4790-8c37-ba69a17013c2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:35.366115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 307/613] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:35.372345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cb32-8a67-4790-8c37-ba69a17013c2 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:35.408818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587fb21-e5ee-4d10-9652-5e65bee14ba7 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:35.428145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:35.468518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90102f-9d04-4480-a8b9-7ba05ba0e935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:35.469349 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90102f-9d04-4480-a8b9-7ba05ba0e935 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:35.469659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90102f-9d04-4480-a8b9-7ba05ba0e935 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:35.469898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90102f-9d04-4480-a8b9-7ba05ba0e935 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:35.486837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90102f-9d04-4480-a8b9-7ba05ba0e935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-ec90102f-9d04-4480-a8b9-7ba05ba0e935 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:35.496328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:35.497759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:35.498873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 307/614] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:35.507761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90102f-9d04-4480-a8b9-7ba05ba0e935 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:35.542263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cb32-8a67-4790-8c37-ba69a17013c2 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:35.586689 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccecb2-c577-40df-83f3-8475183b6f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:35.587913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccecb2-c577-40df-83f3-8475183b6f51 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:35.588832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccecb2-c577-40df-83f3-8475183b6f51 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:35.589250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccecb2-c577-40df-83f3-8475183b6f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:35.591680 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:35.603069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccecb2-c577-40df-83f3-8475183b6f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:35.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccecb2-c577-40df-83f3-8475183b6f51 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-02ccecb2-c577-40df-83f3-8475183b6f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:35.626645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:35.627591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:35.628545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:35.628545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:35.628545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:35.628545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:35.630502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 308/615] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:35.640669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccecb2-c577-40df-83f3-8475183b6f51 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:35.645074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90102f-9d04-4480-a8b9-7ba05ba0e935 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:35.681508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b397b-52aa-46ed-aadf-af8a35208052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:35.687761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b397b-52aa-46ed-aadf-af8a35208052 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:35.687761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b397b-52aa-46ed-aadf-af8a35208052 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:35.687761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b397b-52aa-46ed-aadf-af8a35208052 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:35.687761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b397b-52aa-46ed-aadf-af8a35208052 None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:35.687761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b397b-52aa-46ed-aadf-af8a35208052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:35.687761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b397b-52aa-46ed-aadf-af8a35208052 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:35.699779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 308/616] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:35.701590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b397b-52aa-46ed-aadf-af8a35208052 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:35.756144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:35.839524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccecb2-c577-40df-83f3-8475183b6f51 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:35.878604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b397b-52aa-46ed-aadf-af8a35208052 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:35.907356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059570a7-15ef-41ae-bc25-1fee69297547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:35.908087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059570a7-15ef-41ae-bc25-1fee69297547 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:35.908380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059570a7-15ef-41ae-bc25-1fee69297547 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:35.908652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059570a7-15ef-41ae-bc25-1fee69297547 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:35.909378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059570a7-15ef-41ae-bc25-1fee69297547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:35.909756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059570a7-15ef-41ae-bc25-1fee69297547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:35.911135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059570a7-15ef-41ae-bc25-1fee69297547 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:35.936686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 309/617] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:35.942578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059570a7-15ef-41ae-bc25-1fee69297547 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:35.960440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de341b-855b-4dfe-ad19-5fb019a7bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:35.961251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de341b-855b-4dfe-ad19-5fb019a7bb2a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:35.961537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de341b-855b-4dfe-ad19-5fb019a7bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:35.961816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de341b-855b-4dfe-ad19-5fb019a7bb2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:35.992970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de341b-855b-4dfe-ad19-5fb019a7bb2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:35.994453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de341b-855b-4dfe-ad19-5fb019a7bb2a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:35.995066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-47de341b-855b-4dfe-ad19-5fb019a7bb2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:36.037189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:36.038415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:36.039275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:36.039275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:36.039275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:36.039275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:36.039275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 309/618] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:36.046855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de341b-855b-4dfe-ad19-5fb019a7bb2a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:36.058515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059570a7-15ef-41ae-bc25-1fee69297547 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:36.124396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52155855-0032-4eaf-9854-7d80450f775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:36.125150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155855-0032-4eaf-9854-7d80450f775f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.125471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155855-0032-4eaf-9854-7d80450f775f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.125743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155855-0032-4eaf-9854-7d80450f775f None admin] PATH_INFO: `/v3/users/swift` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.137649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52155855-0032-4eaf-9854-7d80450f775f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:36.139103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52155855-0032-4eaf-9854-7d80450f775f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-52155855-0032-4eaf-9854-7d80450f775f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:36.164203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:36.165213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:36.166142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:36.177967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 310/619] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:36.184379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52155855-0032-4eaf-9854-7d80450f775f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:36.188944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:36.209036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de341b-855b-4dfe-ad19-5fb019a7bb2a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:36.274644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648db373-68ea-4905-84d5-a5aeaaed17bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:36.275589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db373-68ea-4905-84d5-a5aeaaed17bd None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.276962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db373-68ea-4905-84d5-a5aeaaed17bd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.277381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db373-68ea-4905-84d5-a5aeaaed17bd None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.281646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648db373-68ea-4905-84d5-a5aeaaed17bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:36.282160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648db373-68ea-4905-84d5-a5aeaaed17bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:36.283694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648db373-68ea-4905-84d5-a5aeaaed17bd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:36.309345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 310/620] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:36.317552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648db373-68ea-4905-84d5-a5aeaaed17bd None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:36.379761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52155855-0032-4eaf-9854-7d80450f775f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:36.395485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:36.462268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648db373-68ea-4905-84d5-a5aeaaed17bd None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:36.475931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a00d5a-fc46-4f0c-8d67-8adc0ba4beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:36.476962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a00d5a-fc46-4f0c-8d67-8adc0ba4beb9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.477447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a00d5a-fc46-4f0c-8d67-8adc0ba4beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.477916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a00d5a-fc46-4f0c-8d67-8adc0ba4beb9 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.479103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a00d5a-fc46-4f0c-8d67-8adc0ba4beb9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:36.480372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a00d5a-fc46-4f0c-8d67-8adc0ba4beb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:36.482253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a00d5a-fc46-4f0c-8d67-8adc0ba4beb9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:36.517945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 311/621] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 16 00:20:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:36.524321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a00d5a-fc46-4f0c-8d67-8adc0ba4beb9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:36.530240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a96c31-8f92-46b5-a8c4-c8f2665a9617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:36.531310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96c31-8f92-46b5-a8c4-c8f2665a9617 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.532282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96c31-8f92-46b5-a8c4-c8f2665a9617 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.532806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96c31-8f92-46b5-a8c4-c8f2665a9617 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.542017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a96c31-8f92-46b5-a8c4-c8f2665a9617 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:36.543921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a96c31-8f92-46b5-a8c4-c8f2665a9617 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-47a96c31-8f92-46b5-a8c4-c8f2665a9617 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:36.560868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:36.561799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:36.562753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:36.566100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 311/622] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 16 00:20:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:36.572408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a96c31-8f92-46b5-a8c4-c8f2665a9617 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:36.577066 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:36.709685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a96c31-8f92-46b5-a8c4-c8f2665a9617 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:36.755756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c08db-6910-4312-933d-170e839a2a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:36.756697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c08db-6910-4312-933d-170e839a2a33 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.756981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c08db-6910-4312-933d-170e839a2a33 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.757259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c08db-6910-4312-933d-170e839a2a33 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.758093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c08db-6910-4312-933d-170e839a2a33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:36.758400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c08db-6910-4312-933d-170e839a2a33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:36.759894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c08db-6910-4312-933d-170e839a2a33 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:36.766409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a00d5a-fc46-4f0c-8d67-8adc0ba4beb9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:36.781163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 312/623] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 16 00:20:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:36.786495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c08db-6910-4312-933d-170e839a2a33 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:36.840276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e4763-91fd-40e6-84fb-b2c34ed3cfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:36.841199 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e4763-91fd-40e6-84fb-b2c34ed3cfaf None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.841481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e4763-91fd-40e6-84fb-b2c34ed3cfaf None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.841753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e4763-91fd-40e6-84fb-b2c34ed3cfaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.871327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e4763-91fd-40e6-84fb-b2c34ed3cfaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:36.873381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e4763-91fd-40e6-84fb-b2c34ed3cfaf None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-1f3e4763-91fd-40e6-84fb-b2c34ed3cfaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:36.915069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:36.916050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:36.916932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:36.916932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:36.916932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:36.916932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:36.916932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 312/624] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:36.917778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137ad09-6c9d-4b74-a486-f5c1d3b54891 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.917878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137ad09-6c9d-4b74-a486-f5c1d3b54891 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.918074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137ad09-6c9d-4b74-a486-f5c1d3b54891 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.918843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:36.919364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 313/625] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:36.924960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df24dbd-7b6e-4f43-a6e3-2d42b8e90c2a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.925246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df24dbd-7b6e-4f43-a6e3-2d42b8e90c2a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.925524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df24dbd-7b6e-4f43-a6e3-2d42b8e90c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.942956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9df24dbd-7b6e-4f43-a6e3-2d42b8e90c2a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:36.944156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9df24dbd-7b6e-4f43-a6e3-2d42b8e90c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:36.956467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:36.965218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c08db-6910-4312-933d-170e839a2a33 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.007187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42203f9-8767-4bef-be6c-f62cb401c0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.007933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42203f9-8767-4bef-be6c-f62cb401c0f5 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.008216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42203f9-8767-4bef-be6c-f62cb401c0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.008493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42203f9-8767-4bef-be6c-f62cb401c0f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.017323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 314/626] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:37.018849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df24dbd-7b6e-4f43-a6e3-2d42b8e90c2a None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.099359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42203f9-8767-4bef-be6c-f62cb401c0f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:37.101628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42203f9-8767-4bef-be6c-f62cb401c0f5 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:37.136444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df24dbd-7b6e-4f43-a6e3-2d42b8e90c2a None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.173051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f58f-9819-44b1-b741-a7bd0486f2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.173745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f58f-9819-44b1-b741-a7bd0486f2a1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.174038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:37.174891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f58f-9819-44b1-b741-a7bd0486f2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.175074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f58f-9819-44b1-b741-a7bd0486f2a1 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.175797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16f58f-9819-44b1-b741-a7bd0486f2a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:37.176111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16f58f-9819-44b1-b741-a7bd0486f2a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:37.177500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16f58f-9819-44b1-b741-a7bd0486f2a1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:37.190111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 315/627] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:37.191032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f58f-9819-44b1-b741-a7bd0486f2a1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.201448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:37.228114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 313/628] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:37.230273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419ef7-e9c9-43c8-a046-22914904577d None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.230562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419ef7-e9c9-43c8-a046-22914904577d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.230842 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d419ef7-e9c9-43c8-a046-22914904577d None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.233130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 314/629] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:37.233841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419ef7-e9c9-43c8-a046-22914904577d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.293398 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f58f-9819-44b1-b741-a7bd0486f2a1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.326655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ee6a4-ef82-447b-8f51-98cb972bbf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.327454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ee6a4-ef82-447b-8f51-98cb972bbf98 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.327753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ee6a4-ef82-447b-8f51-98cb972bbf98 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.328041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ee6a4-ef82-447b-8f51-98cb972bbf98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.338189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ee6a4-ef82-447b-8f51-98cb972bbf98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-f15ee6a4-ef82-447b-8f51-98cb972bbf98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:37.345853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:37.346844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:37.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 316/630] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:37.350511 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d419ef7-e9c9-43c8-a046-22914904577d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.352835 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4200c-72db-4cd8-b838-eade88a2e820 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.353120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4200c-72db-4cd8-b838-eade88a2e820 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.353396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4200c-72db-4cd8-b838-eade88a2e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.369808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-16d4200c-72db-4cd8-b838-eade88a2e820 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:37.370995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-16d4200c-72db-4cd8-b838-eade88a2e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:37.388552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e1f13-079d-4381-9867-eec349866394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.389693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e1f13-079d-4381-9867-eec349866394 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.390149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e1f13-079d-4381-9867-eec349866394 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.390622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e1f13-079d-4381-9867-eec349866394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.397860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e1f13-079d-4381-9867-eec349866394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:37.399628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e1f13-079d-4381-9867-eec349866394 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-fc9e1f13-079d-4381-9867-eec349866394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:37.415223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:37.416237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:37.417312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:37.417312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:37.417312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:37.417312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:37.417312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:37.417312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:37.417312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:37.417312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:37.420084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 315/631] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:37.420867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e1f13-079d-4381-9867-eec349866394 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.437018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:37.455757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 317/632] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:37.455757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4200c-72db-4cd8-b838-eade88a2e820 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.458321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:37.541118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e1f13-079d-4381-9867-eec349866394 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.548122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4200c-72db-4cd8-b838-eade88a2e820 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.574515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42c66-07eb-4eb2-949b-e88a827eca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.575337 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42c66-07eb-4eb2-949b-e88a827eca6b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.575613 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42c66-07eb-4eb2-949b-e88a827eca6b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.575918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42c66-07eb-4eb2-949b-e88a827eca6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.581535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c571890-992a-4845-b325-7a7abb6754e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.582206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c571890-992a-4845-b325-7a7abb6754e2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.582493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c571890-992a-4845-b325-7a7abb6754e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.582771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c571890-992a-4845-b325-7a7abb6754e2 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.583511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c571890-992a-4845-b325-7a7abb6754e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:37.583851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c571890-992a-4845-b325-7a7abb6754e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:37.585214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c571890-992a-4845-b325-7a7abb6754e2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:37.586863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42c66-07eb-4eb2-949b-e88a827eca6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:37.588343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42c66-07eb-4eb2-949b-e88a827eca6b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:37.598103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 318/633] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:37.598103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c571890-992a-4845-b325-7a7abb6754e2 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-a3a42c66-07eb-4eb2-949b-e88a827eca6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:37.610306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:37.611175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:37.612080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:37.612080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:37.612080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:37.612080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:37.612080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 316/634] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:37.612347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42c66-07eb-4eb2-949b-e88a827eca6b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.665373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:37.690014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:37.714467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c571890-992a-4845-b325-7a7abb6754e2 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.719205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42c66-07eb-4eb2-949b-e88a827eca6b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.753253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97de2e0-6d01-4e70-8e4c-b6ca5482cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.754156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97de2e0-6d01-4e70-8e4c-b6ca5482cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.754625 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97de2e0-6d01-4e70-8e4c-b6ca5482cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.754898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97de2e0-6d01-4e70-8e4c-b6ca5482cfb4 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.755660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97de2e0-6d01-4e70-8e4c-b6ca5482cfb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:37.755999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97de2e0-6d01-4e70-8e4c-b6ca5482cfb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:37.757676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97de2e0-6d01-4e70-8e4c-b6ca5482cfb4 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:37.758524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95def-6305-4191-9be4-5d39546c571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.759317 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95def-6305-4191-9be4-5d39546c571e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.759601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95def-6305-4191-9be4-5d39546c571e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.759915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95def-6305-4191-9be4-5d39546c571e None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.770941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 319/635] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:37.771997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f95def-6305-4191-9be4-5d39546c571e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:37.772107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97de2e0-6d01-4e70-8e4c-b6ca5482cfb4 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-a3f95def-6305-4191-9be4-5d39546c571e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:37.780448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:37.781397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:37.782249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 317/636] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:37.782926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95def-6305-4191-9be4-5d39546c571e None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.872510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97de2e0-6d01-4e70-8e4c-b6ca5482cfb4 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.881802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95def-6305-4191-9be4-5d39546c571e None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:37.891472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:37.908724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5a6b9-4646-4b93-8313-777c5e6faecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.909515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5a6b9-4646-4b93-8313-777c5e6faecb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.909800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5a6b9-4646-4b93-8313-777c5e6faecb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.910075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5a6b9-4646-4b93-8313-777c5e6faecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.915722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdfbe3-9811-40e9-8a99-0206287bcba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:37.916394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdfbe3-9811-40e9-8a99-0206287bcba7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.916678 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdfbe3-9811-40e9-8a99-0206287bcba7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.916985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdfbe3-9811-40e9-8a99-0206287bcba7 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.917715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdfbe3-9811-40e9-8a99-0206287bcba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:37.918319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdfbe3-9811-40e9-8a99-0206287bcba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:37.919397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdfbe3-9811-40e9-8a99-0206287bcba7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:37.920227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5a6b9-4646-4b93-8313-777c5e6faecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:37.920846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:37.921668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5a6b9-4646-4b93-8313-777c5e6faecb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:37.931254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 318/637] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:37.932522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3acc-6fce-46b4-a62b-5a0876633868 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:37.932825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3acc-6fce-46b4-a62b-5a0876633868 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:37.933092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3acc-6fce-46b4-a62b-5a0876633868 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:37.934500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 319/638] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:37.935030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3acc-6fce-46b4-a62b-5a0876633868 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-dcc5a6b9-4646-4b93-8313-777c5e6faecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:37.943443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:37.944346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:37.945245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:37.945245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:37.945245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:37.945245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:37.945245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 320/639] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:37.945513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5a6b9-4646-4b93-8313-777c5e6faecb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.038885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3acc-6fce-46b4-a62b-5a0876633868 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.047835 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5a6b9-4646-4b93-8313-777c5e6faecb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.071786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0b91a-c862-49af-967e-d3e78074e18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.072671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0b91a-c862-49af-967e-d3e78074e18c None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.072952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0b91a-c862-49af-967e-d3e78074e18c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.073225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0b91a-c862-49af-967e-d3e78074e18c None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/e7ccca2836bc4004bcf39a3070b6c54f/roles/ef759eb79f6242fbbc2ec11a7807ad23` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.081414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0434201-7951-49dc-af3d-569f2a9c9a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.082085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434201-7951-49dc-af3d-569f2a9c9a2f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.082374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434201-7951-49dc-af3d-569f2a9c9a2f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.082663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434201-7951-49dc-af3d-569f2a9c9a2f None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.083382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0434201-7951-49dc-af3d-569f2a9c9a2f None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:38.083692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0434201-7951-49dc-af3d-569f2a9c9a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:38.085144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0434201-7951-49dc-af3d-569f2a9c9a2f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:38.091758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0b91a-c862-49af-967e-d3e78074e18c None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=e7ccca2836bc4004bcf39a3070b6c54f, role_id=ef759eb79f6242fbbc2ec11a7807ad23)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:38.093406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0b91a-c862-49af-967e-d3e78074e18c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:38.096523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 321/640] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:38.101700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0434201-7951-49dc-af3d-569f2a9c9a2f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.133766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:38.160717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 320/641] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:20:37 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/e7ccca2836bc4004bcf39a3070b6c54f/roles/ef759eb79f6242fbbc2ec11a7807ad23 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:38.162464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fb108-d544-4ce4-a0ce-3a0bbe946206 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.162760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fb108-d544-4ce4-a0ce-3a0bbe946206 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.163043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fb108-d544-4ce4-a0ce-3a0bbe946206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.193176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4e5fb108-d544-4ce4-a0ce-3a0bbe946206 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:38.195215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4e5fb108-d544-4ce4-a0ce-3a0bbe946206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:38.228151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0434201-7951-49dc-af3d-569f2a9c9a2f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.256249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:38.283486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3899-5d69-41ed-b044-07cbd5e1a4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.284934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3899-5d69-41ed-b044-07cbd5e1a4b2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.285225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3899-5d69-41ed-b044-07cbd5e1a4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.285499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3899-5d69-41ed-b044-07cbd5e1a4b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.294718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b3899-5d69-41ed-b044-07cbd5e1a4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:38.296229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b3899-5d69-41ed-b044-07cbd5e1a4b2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:38.303167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 321/642] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:38.303852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fb108-d544-4ce4-a0ce-3a0bbe946206 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-c40b3899-5d69-41ed-b044-07cbd5e1a4b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:38.323107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:38.324163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:38.325670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:38.325670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:38.325670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:38.325670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:38.325670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:38.325670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:38.325670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:38.325670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:38.328633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 322/643] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:38.328633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3899-5d69-41ed-b044-07cbd5e1a4b2 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.432810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:38.435811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fb108-d544-4ce4-a0ce-3a0bbe946206 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.442642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3899-5d69-41ed-b044-07cbd5e1a4b2 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.481532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc390d-f4d0-451d-9731-1fb530275dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.483119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc390d-f4d0-451d-9731-1fb530275dab None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.483614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc390d-f4d0-451d-9731-1fb530275dab None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.484112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc390d-f4d0-451d-9731-1fb530275dab None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.485552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc390d-f4d0-451d-9731-1fb530275dab None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:38.486071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc390d-f4d0-451d-9731-1fb530275dab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:38.488539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc390d-f4d0-451d-9731-1fb530275dab None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:38.489659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864c914-b9a5-4615-9bca-c4ad18c2f513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.490472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864c914-b9a5-4615-9bca-c4ad18c2f513 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.490748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864c914-b9a5-4615-9bca-c4ad18c2f513 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.491015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864c914-b9a5-4615-9bca-c4ad18c2f513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.502838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864c914-b9a5-4615-9bca-c4ad18c2f513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:38.503389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 322/644] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:38.504354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864c914-b9a5-4615-9bca-c4ad18c2f513 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:38.504746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc390d-f4d0-451d-9731-1fb530275dab None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-6864c914-b9a5-4615-9bca-c4ad18c2f513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:38.526422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:38.527358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:38.528481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:38.528481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:38.528481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:38.528481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:38.528481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 323/645] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:38.528481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864c914-b9a5-4615-9bca-c4ad18c2f513 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.549632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:38.621620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc390d-f4d0-451d-9731-1fb530275dab None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.635017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864c914-b9a5-4615-9bca-c4ad18c2f513 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.660779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e3ec4-b9b9-4b0b-b9d8-16f2b6d34d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.661580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e3ec4-b9b9-4b0b-b9d8-16f2b6d34d53 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.661858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e3ec4-b9b9-4b0b-b9d8-16f2b6d34d53 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.662130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e3ec4-b9b9-4b0b-b9d8-16f2b6d34d53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.673444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03b0ab-2ee3-4ea6-a5c5-da0fc2289dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.673702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e3ec4-b9b9-4b0b-b9d8-16f2b6d34d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:38.674713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03b0ab-2ee3-4ea6-a5c5-da0fc2289dc8 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.675195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03b0ab-2ee3-4ea6-a5c5-da0fc2289dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.675672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03b0ab-2ee3-4ea6-a5c5-da0fc2289dc8 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.676683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03b0ab-2ee3-4ea6-a5c5-da0fc2289dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:38.677203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03b0ab-2ee3-4ea6-a5c5-da0fc2289dc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:38.678811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03b0ab-2ee3-4ea6-a5c5-da0fc2289dc8 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-5c8e3ec4-b9b9-4b0b-b9d8-16f2b6d34d53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:38.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:38.682257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:38.683134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 323/646] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:38.684740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e3ec4-b9b9-4b0b-b9d8-16f2b6d34d53 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.694701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 324/647] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:38.695906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03b0ab-2ee3-4ea6-a5c5-da0fc2289dc8 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.702629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:38.793019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:38.800165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03b0ab-2ee3-4ea6-a5c5-da0fc2289dc8 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.800489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e3ec4-b9b9-4b0b-b9d8-16f2b6d34d53 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.835107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179259-dd1e-4762-b2c9-0fca6ef20705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.835897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179259-dd1e-4762-b2c9-0fca6ef20705 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.836271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179259-dd1e-4762-b2c9-0fca6ef20705 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.836638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179259-dd1e-4762-b2c9-0fca6ef20705 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.837454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179259-dd1e-4762-b2c9-0fca6ef20705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:38.837548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac1cf-6c00-457e-b5ef-74ca99997088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.837765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179259-dd1e-4762-b2c9-0fca6ef20705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:38.838283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac1cf-6c00-457e-b5ef-74ca99997088 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.838564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac1cf-6c00-457e-b5ef-74ca99997088 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.838837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac1cf-6c00-457e-b5ef-74ca99997088 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.839139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179259-dd1e-4762-b2c9-0fca6ef20705 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:38.847126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac1cf-6c00-457e-b5ef-74ca99997088 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:38.848697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac1cf-6c00-457e-b5ef-74ca99997088 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:38.852863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 325/648] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:38.853522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179259-dd1e-4762-b2c9-0fca6ef20705 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-d06ac1cf-6c00-457e-b5ef-74ca99997088 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:38.868676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:38.870159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 324/649] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:38.874031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac1cf-6c00-457e-b5ef-74ca99997088 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.935536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:38.979349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179259-dd1e-4762-b2c9-0fca6ef20705 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.988955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac1cf-6c00-457e-b5ef-74ca99997088 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:39.017457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3623d-8625-4ba5-927e-6b575496e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.018470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3623d-8625-4ba5-927e-6b575496e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.018756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3623d-8625-4ba5-927e-6b575496e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.019299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3623d-8625-4ba5-927e-6b575496e9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.020069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3623d-8625-4ba5-927e-6b575496e9c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:39.020423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3623d-8625-4ba5-927e-6b575496e9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.021756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3623d-8625-4ba5-927e-6b575496e9c8 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:39.025549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649897c6-6e5d-4935-b8a7-59796cc3e629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.025549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649897c6-6e5d-4935-b8a7-59796cc3e629 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.025549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649897c6-6e5d-4935-b8a7-59796cc3e629 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.025549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649897c6-6e5d-4935-b8a7-59796cc3e629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.025952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649897c6-6e5d-4935-b8a7-59796cc3e629 None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=ba29f9c029fe4390af3b6ce1b2147ce9) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:39.025952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649897c6-6e5d-4935-b8a7-59796cc3e629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.026571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649897c6-6e5d-4935-b8a7-59796cc3e629 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:39.044145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 325/650] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/role_assignments?user.id=ba29f9c029fe4390af3b6ce1b2147ce9&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:39.044145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649897c6-6e5d-4935-b8a7-59796cc3e629 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:39.044470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 326/651] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:39.044470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3623d-8625-4ba5-927e-6b575496e9c8 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:39.067061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:39.156919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649897c6-6e5d-4935-b8a7-59796cc3e629 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:39.186370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3623d-8625-4ba5-927e-6b575496e9c8 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:39.194489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a03ed7-1b5d-431d-98e9-3e3245967aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.195444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a03ed7-1b5d-431d-98e9-3e3245967aad None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.195832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a03ed7-1b5d-431d-98e9-3e3245967aad None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.196187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a03ed7-1b5d-431d-98e9-3e3245967aad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.206721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a03ed7-1b5d-431d-98e9-3e3245967aad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.209402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a03ed7-1b5d-431d-98e9-3e3245967aad None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-31a03ed7-1b5d-431d-98e9-3e3245967aad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:39.226141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:39.227373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:39.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 326/652] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:39.230282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:39.230433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a03ed7-1b5d-431d-98e9-3e3245967aad None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:39.239003 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad6d40-37c0-45d8-90e0-5d0972f125f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.241111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad6d40-37c0-45d8-90e0-5d0972f125f1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.241111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad6d40-37c0-45d8-90e0-5d0972f125f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.241111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad6d40-37c0-45d8-90e0-5d0972f125f1 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.241842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad6d40-37c0-45d8-90e0-5d0972f125f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:39.242448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad6d40-37c0-45d8-90e0-5d0972f125f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.244136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad6d40-37c0-45d8-90e0-5d0972f125f1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:39.265307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 327/653] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 16 00:20:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:39.274464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad6d40-37c0-45d8-90e0-5d0972f125f1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:39.346270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:39.370562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a03ed7-1b5d-431d-98e9-3e3245967aad None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:39.393361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad6d40-37c0-45d8-90e0-5d0972f125f1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:39.410815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ade93-e4f8-46bb-a770-51975ae899a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.411904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ade93-e4f8-46bb-a770-51975ae899a8 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.412279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ade93-e4f8-46bb-a770-51975ae899a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.412649 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ade93-e4f8-46bb-a770-51975ae899a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.424917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ade93-e4f8-46bb-a770-51975ae899a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.426498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ade93-e4f8-46bb-a770-51975ae899a8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:39.437527 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38b885-3145-471d-92f8-e76f9813c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.438384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38b885-3145-471d-92f8-e76f9813c43c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.438844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38b885-3145-471d-92f8-e76f9813c43c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.439389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38b885-3145-471d-92f8-e76f9813c43c None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.440393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38b885-3145-471d-92f8-e76f9813c43c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:39.440863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38b885-3145-471d-92f8-e76f9813c43c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.442436 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38b885-3145-471d-92f8-e76f9813c43c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-bd0ade93-e4f8-46bb-a770-51975ae899a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:39.445685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:39.446732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:39.447833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:39.447833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:39.447833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:39.447833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:39.448936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 327/654] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:39.450330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ade93-e4f8-46bb-a770-51975ae899a8 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:39.467311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 328/655] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Jun 16 00:20:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:39.468475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38b885-3145-471d-92f8-e76f9813c43c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:39.522595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:39.568553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ade93-e4f8-46bb-a770-51975ae899a8 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:39.600729 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:39.601668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38b885-3145-471d-92f8-e76f9813c43c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:39.607586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99b5ea-77c1-416b-896b-1667f0292c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.608418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99b5ea-77c1-416b-896b-1667f0292c28 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.608800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99b5ea-77c1-416b-896b-1667f0292c28 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.609174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99b5ea-77c1-416b-896b-1667f0292c28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.647836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a3206-ff90-4607-9e57-e1574a46b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.648784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a3206-ff90-4607-9e57-e1574a46b19e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.649222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a3206-ff90-4607-9e57-e1574a46b19e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.649665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a3206-ff90-4607-9e57-e1574a46b19e None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.651046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a3206-ff90-4607-9e57-e1574a46b19e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:39.651517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a3206-ff90-4607-9e57-e1574a46b19e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.654166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a3206-ff90-4607-9e57-e1574a46b19e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:39.667063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 329/656] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:39.668219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a3206-ff90-4607-9e57-e1574a46b19e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:39.690066 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99b5ea-77c1-416b-896b-1667f0292c28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.692550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99b5ea-77c1-416b-896b-1667f0292c28 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:39.774021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a3206-ff90-4607-9e57-e1574a46b19e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:39.775899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:39.811177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8a90c-55df-44d7-a980-d5fd1e0e2ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.812004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8a90c-55df-44d7-a980-d5fd1e0e2ebc None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.812390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8a90c-55df-44d7-a980-d5fd1e0e2ebc None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.812766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8a90c-55df-44d7-a980-d5fd1e0e2ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.836337 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 328/657] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:39.837503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99b5ea-77c1-416b-896b-1667f0292c28 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:39.870500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:39.893123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8a90c-55df-44d7-a980-d5fd1e0e2ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.894720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8a90c-55df-44d7-a980-d5fd1e0e2ebc None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:39.945307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99b5ea-77c1-416b-896b-1667f0292c28 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:39.981309 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4721bbf-e501-474b-85fe-4f23a13f03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:39.982447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4721bbf-e501-474b-85fe-4f23a13f03bd None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:39.982912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4721bbf-e501-474b-85fe-4f23a13f03bd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:39.983376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4721bbf-e501-474b-85fe-4f23a13f03bd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:39.991015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4721bbf-e501-474b-85fe-4f23a13f03bd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:39.992736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4721bbf-e501-474b-85fe-4f23a13f03bd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.000651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 330/658] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:40.001610 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8a90c-55df-44d7-a980-d5fd1e0e2ebc None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.003930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-c4721bbf-e501-474b-85fe-4f23a13f03bd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:40.009712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:40.010645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:20:40.011619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:40.018410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 329/659] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:40.018410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4721bbf-e501-474b-85fe-4f23a13f03bd None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.112993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8a90c-55df-44d7-a980-d5fd1e0e2ebc None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.113586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:40.124678 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4721bbf-e501-474b-85fe-4f23a13f03bd None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.151332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210737b2-c4cd-4538-b252-2b41b6316f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.152186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210737b2-c4cd-4538-b252-2b41b6316f7c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.152563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210737b2-c4cd-4538-b252-2b41b6316f7c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.152945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210737b2-c4cd-4538-b252-2b41b6316f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.162261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2e7eb-7ec4-4428-bf50-23c6ee6285f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.163348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2e7eb-7ec4-4428-bf50-23c6ee6285f7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.163458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210737b2-c4cd-4538-b252-2b41b6316f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.163953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2e7eb-7ec4-4428-bf50-23c6ee6285f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.164446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2e7eb-7ec4-4428-bf50-23c6ee6285f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.164959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210737b2-c4cd-4538-b252-2b41b6316f7c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.176114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2e7eb-7ec4-4428-bf50-23c6ee6285f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.177892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2e7eb-7ec4-4428-bf50-23c6ee6285f7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-210737b2-c4cd-4538-b252-2b41b6316f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:40.183391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:40.184886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:40.185749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:40.185749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:40.185749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:40.185749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:40.189840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 331/660] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:40.190666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210737b2-c4cd-4538-b252-2b41b6316f7c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-c1c2e7eb-7ec4-4428-bf50-23c6ee6285f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:40.200652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:40.201798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:40.202657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:40.202657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:40.202657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:40.202657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:40.204932 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 330/661] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:40.205970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2e7eb-7ec4-4428-bf50-23c6ee6285f7 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.252118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:40.300522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210737b2-c4cd-4538-b252-2b41b6316f7c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.315914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2e7eb-7ec4-4428-bf50-23c6ee6285f7 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.337567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a9ed8-e5ea-4b05-b0dc-60cc5de9fb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.338433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a9ed8-e5ea-4b05-b0dc-60cc5de9fb88 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.338722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a9ed8-e5ea-4b05-b0dc-60cc5de9fb88 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.339001 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a9ed8-e5ea-4b05-b0dc-60cc5de9fb88 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.339868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a9ed8-e5ea-4b05-b0dc-60cc5de9fb88 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:40.340180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a9ed8-e5ea-4b05-b0dc-60cc5de9fb88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.341747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a9ed8-e5ea-4b05-b0dc-60cc5de9fb88 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.359131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801a925-4e8d-4e32-92af-8341d20d4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.360117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801a925-4e8d-4e32-92af-8341d20d4e94 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.363874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 332/662] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:40.363874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a9ed8-e5ea-4b05-b0dc-60cc5de9fb88 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.364862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801a925-4e8d-4e32-92af-8341d20d4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.365152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801a925-4e8d-4e32-92af-8341d20d4e94 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.365900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801a925-4e8d-4e32-92af-8341d20d4e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:40.366210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801a925-4e8d-4e32-92af-8341d20d4e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.367606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801a925-4e8d-4e32-92af-8341d20d4e94 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.384059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 331/663] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:40.385782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4974ec0-58ff-4ef8-b8b0-71e8f7597162 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.386077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4974ec0-58ff-4ef8-b8b0-71e8f7597162 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.386356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4974ec0-58ff-4ef8-b8b0-71e8f7597162 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.387678 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 332/664] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:40.388404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4974ec0-58ff-4ef8-b8b0-71e8f7597162 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.391518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:40.477623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a9ed8-e5ea-4b05-b0dc-60cc5de9fb88 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.493041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:40.494005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4974ec0-58ff-4ef8-b8b0-71e8f7597162 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.514864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34967fc-7daa-491b-b85e-e9268b226ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.515893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34967fc-7daa-491b-b85e-e9268b226ec6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.516329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34967fc-7daa-491b-b85e-e9268b226ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.516812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34967fc-7daa-491b-b85e-e9268b226ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.517725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34967fc-7daa-491b-b85e-e9268b226ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:40.518179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34967fc-7daa-491b-b85e-e9268b226ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.519960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34967fc-7daa-491b-b85e-e9268b226ec6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.526632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43b881-f183-4014-ae7e-c69655cbfa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.527277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43b881-f183-4014-ae7e-c69655cbfa32 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.527562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43b881-f183-4014-ae7e-c69655cbfa32 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.528395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43b881-f183-4014-ae7e-c69655cbfa32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.533259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 333/665] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:40.534266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34967fc-7daa-491b-b85e-e9268b226ec6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.597114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43b881-f183-4014-ae7e-c69655cbfa32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.599051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43b881-f183-4014-ae7e-c69655cbfa32 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.600884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:40.643608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34967fc-7daa-491b-b85e-e9268b226ec6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.686394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c985e99-40ac-40ca-8627-9713c2268f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.687601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c985e99-40ac-40ca-8627-9713c2268f62 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.688094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c985e99-40ac-40ca-8627-9713c2268f62 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.688844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c985e99-40ac-40ca-8627-9713c2268f62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.697371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 333/666] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:40.697793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c985e99-40ac-40ca-8627-9713c2268f62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.698641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b218f-ee5d-4c10-9100-0f66c8d87c4c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.698934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b218f-ee5d-4c10-9100-0f66c8d87c4c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.699209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b218f-ee5d-4c10-9100-0f66c8d87c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.700066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c985e99-40ac-40ca-8627-9713c2268f62 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.717092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-430b218f-ee5d-4c10-9100-0f66c8d87c4c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:40.718264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-430b218f-ee5d-4c10-9100-0f66c8d87c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-2c985e99-40ac-40ca-8627-9713c2268f62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:40.719135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:40.720091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:40.721041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:40.721041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:40.721041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:40.721041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:40.721041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:40.721041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:40.721041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:40.721041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:40.727216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 334/667] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:40.727216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c985e99-40ac-40ca-8627-9713c2268f62 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.755859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:40.787405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 334/668] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:40.788573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b218f-ee5d-4c10-9100-0f66c8d87c4c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.827397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:40.839801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c985e99-40ac-40ca-8627-9713c2268f62 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.874275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c82305-4900-4e81-8699-91bc4c403724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.875067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c82305-4900-4e81-8699-91bc4c403724 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.875355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c82305-4900-4e81-8699-91bc4c403724 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.875637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c82305-4900-4e81-8699-91bc4c403724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.882713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c82305-4900-4e81-8699-91bc4c403724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.884186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c82305-4900-4e81-8699-91bc4c403724 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-14c82305-4900-4e81-8699-91bc4c403724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:40.898458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:40.899336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:40.900599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:40.900599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:40.900599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:40.900599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:40.900599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:40.900599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:40.900599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:40.900599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:40.901056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b218f-ee5d-4c10-9100-0f66c8d87c4c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.901133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 335/669] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:40.901133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c82305-4900-4e81-8699-91bc4c403724 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.940268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7878ce-3321-4000-999d-def1d3a2f554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.941063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7878ce-3321-4000-999d-def1d3a2f554 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.941348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7878ce-3321-4000-999d-def1d3a2f554 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.941625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7878ce-3321-4000-999d-def1d3a2f554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.952445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7878ce-3321-4000-999d-def1d3a2f554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.953910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7878ce-3321-4000-999d-def1d3a2f554 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-0a7878ce-3321-4000-999d-def1d3a2f554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:40.972414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:40.973324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:40.974206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:40.974206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:40.974206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:40.974206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:40.974206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 335/670] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:40.974485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7878ce-3321-4000-999d-def1d3a2f554 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.998751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:41.008334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c82305-4900-4e81-8699-91bc4c403724 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.049202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af781e24-8321-4bf3-94f0-c2850ae8d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.049868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af781e24-8321-4bf3-94f0-c2850ae8d2ba None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.050155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af781e24-8321-4bf3-94f0-c2850ae8d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.050441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af781e24-8321-4bf3-94f0-c2850ae8d2ba None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.051224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af781e24-8321-4bf3-94f0-c2850ae8d2ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:41.051537 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af781e24-8321-4bf3-94f0-c2850ae8d2ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:41.053016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af781e24-8321-4bf3-94f0-c2850ae8d2ba None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:41.069635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 336/671] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:41.069635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af781e24-8321-4bf3-94f0-c2850ae8d2ba None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:41.070456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:41.088162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7878ce-3321-4000-999d-def1d3a2f554 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.123689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51d4d2-e5ac-434d-a738-c5181a1e0811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.124512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51d4d2-e5ac-434d-a738-c5181a1e0811 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.124796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51d4d2-e5ac-434d-a738-c5181a1e0811 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.125072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51d4d2-e5ac-434d-a738-c5181a1e0811 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.135400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51d4d2-e5ac-434d-a738-c5181a1e0811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-1b51d4d2-e5ac-434d-a738-c5181a1e0811 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:41.143659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:41.144732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:41.145595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 336/672] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:41.146782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51d4d2-e5ac-434d-a738-c5181a1e0811 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:41.178817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af781e24-8321-4bf3-94f0-c2850ae8d2ba None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.215693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7211533-27c7-4c06-817a-7b54a107e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.216378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7211533-27c7-4c06-817a-7b54a107e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.216663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7211533-27c7-4c06-817a-7b54a107e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.216944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7211533-27c7-4c06-817a-7b54a107e6e9 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.217718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7211533-27c7-4c06-817a-7b54a107e6e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:41.218030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7211533-27c7-4c06-817a-7b54a107e6e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:41.219467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7211533-27c7-4c06-817a-7b54a107e6e9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:41.231281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 337/673] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:41.232267 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7211533-27c7-4c06-817a-7b54a107e6e9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:41.252529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:41.263235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51d4d2-e5ac-434d-a738-c5181a1e0811 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.298679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84a8d2-90a8-48bc-9060-f96ec715aa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.299941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84a8d2-90a8-48bc-9060-f96ec715aa5a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.299941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84a8d2-90a8-48bc-9060-f96ec715aa5a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.299941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84a8d2-90a8-48bc-9060-f96ec715aa5a None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.300681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84a8d2-90a8-48bc-9060-f96ec715aa5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:41.300992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84a8d2-90a8-48bc-9060-f96ec715aa5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:41.302433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84a8d2-90a8-48bc-9060-f96ec715aa5a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:41.320550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 337/674] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:41.320550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84a8d2-90a8-48bc-9060-f96ec715aa5a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:41.321115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:41.358529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7211533-27c7-4c06-817a-7b54a107e6e9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.392797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3372d-3478-4c81-b253-fad91b37b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.393448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3372d-3478-4c81-b253-fad91b37b51a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.393732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3372d-3478-4c81-b253-fad91b37b51a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.394010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3372d-3478-4c81-b253-fad91b37b51a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.394827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3372d-3478-4c81-b253-fad91b37b51a None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=24198f20ebcd4e64a5184fb9fc6764cd) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:41.395139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3372d-3478-4c81-b253-fad91b37b51a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:41.396596 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3372d-3478-4c81-b253-fad91b37b51a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:41.402343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 338/675] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:41 2022] GET /identity/v3/role_assignments?user.id=24198f20ebcd4e64a5184fb9fc6764cd&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:41.403142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3372d-3478-4c81-b253-fad91b37b51a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:41.435267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84a8d2-90a8-48bc-9060-f96ec715aa5a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.474632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb31d45-b0ec-441f-9868-d48396b317ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.475316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb31d45-b0ec-441f-9868-d48396b317ca None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.475663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb31d45-b0ec-441f-9868-d48396b317ca None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.475987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb31d45-b0ec-441f-9868-d48396b317ca None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.476749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb31d45-b0ec-441f-9868-d48396b317ca None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:41.477065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb31d45-b0ec-441f-9868-d48396b317ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:41.478491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb31d45-b0ec-441f-9868-d48396b317ca None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:41.487820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 338/676] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:41.488697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb31d45-b0ec-441f-9868-d48396b317ca None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:41.502592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:41.531789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3372d-3478-4c81-b253-fad91b37b51a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.564516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:41.576755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5aaec-8515-4407-9651-39d3eac9d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.578201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5aaec-8515-4407-9651-39d3eac9d79c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.578495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5aaec-8515-4407-9651-39d3eac9d79c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.578773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5aaec-8515-4407-9651-39d3eac9d79c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.579707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5aaec-8515-4407-9651-39d3eac9d79c None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=20b4902b340a4260a0b5f716c3ae9acf) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:41.580090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5aaec-8515-4407-9651-39d3eac9d79c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:41.581543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5aaec-8515-4407-9651-39d3eac9d79c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:41.596534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 339/677] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:41 2022] GET /identity/v3/role_assignments?user.id=20b4902b340a4260a0b5f716c3ae9acf&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:41.597433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641bab-8b76-4cd8-97bc-74b75f1b039a None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.597722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641bab-8b76-4cd8-97bc-74b75f1b039a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.598002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641bab-8b76-4cd8-97bc-74b75f1b039a None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.599642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 340/678] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:41.600272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55641bab-8b76-4cd8-97bc-74b75f1b039a None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:41.612177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb31d45-b0ec-441f-9868-d48396b317ca None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.663021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2591e-e3e9-49c0-8bd1-41c8d618eeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.665032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2591e-e3e9-49c0-8bd1-41c8d618eeec None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.665324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2591e-e3e9-49c0-8bd1-41c8d618eeec None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.665606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2591e-e3e9-49c0-8bd1-41c8d618eeec None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.674857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2591e-e3e9-49c0-8bd1-41c8d618eeec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:41.676470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2591e-e3e9-49c0-8bd1-41c8d618eeec None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-2cf2591e-e3e9-49c0-8bd1-41c8d618eeec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:41.694082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:41.695221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:41.696330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:41.696330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:41.696330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:41.696330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:41.696330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:41.696330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:41.696330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:41.696330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:41.696330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 339/679] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:41.697041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd95d-a4c0-4c47-9bd9-fa7b219bc924 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.697327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd95d-a4c0-4c47-9bd9-fa7b219bc924 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.697603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd95d-a4c0-4c47-9bd9-fa7b219bc924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.722171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-803fd95d-a4c0-4c47-9bd9-fa7b219bc924 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:41.723603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-803fd95d-a4c0-4c47-9bd9-fa7b219bc924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:41.744399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55641bab-8b76-4cd8-97bc-74b75f1b039a None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.782767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3372981-2399-478e-8990-163abb269dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.783487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3372981-2399-478e-8990-163abb269dd9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.783837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3372981-2399-478e-8990-163abb269dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.784606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3372981-2399-478e-8990-163abb269dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.796753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:41.799420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3372981-2399-478e-8990-163abb269dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:41.800948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3372981-2399-478e-8990-163abb269dd9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:41.802834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 340/680] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:41.811935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fd95d-a4c0-4c47-9bd9-fa7b219bc924 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e3372981-2399-478e-8990-163abb269dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:41.820287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:41.821341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:41.822431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:41.822431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:41.822431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:41.822431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:41.822431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 341/681] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:41.828151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3372981-2399-478e-8990-163abb269dd9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:41.883571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:41.944252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fd95d-a4c0-4c47-9bd9-fa7b219bc924 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.958798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3372981-2399-478e-8990-163abb269dd9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:41.981616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d42eec-2223-4302-8956-0d8f1f273d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:41.982391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d42eec-2223-4302-8956-0d8f1f273d55 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:41.982772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d42eec-2223-4302-8956-0d8f1f273d55 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:41.983555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d42eec-2223-4302-8956-0d8f1f273d55 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:41.984671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d42eec-2223-4302-8956-0d8f1f273d55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:41.984991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d42eec-2223-4302-8956-0d8f1f273d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:41.987153 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d42eec-2223-4302-8956-0d8f1f273d55 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:42.000233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff359f1-cfb8-4319-9c63-387d92261a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:42.000901 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff359f1-cfb8-4319-9c63-387d92261a7a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:42.001183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff359f1-cfb8-4319-9c63-387d92261a7a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:42.001458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff359f1-cfb8-4319-9c63-387d92261a7a None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:42.002180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff359f1-cfb8-4319-9c63-387d92261a7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:42.002488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff359f1-cfb8-4319-9c63-387d92261a7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:42.003890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff359f1-cfb8-4319-9c63-387d92261a7a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:42.013232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 341/682] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:42.013393 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d42eec-2223-4302-8956-0d8f1f273d55 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:42.019354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 342/683] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:42.020214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff359f1-cfb8-4319-9c63-387d92261a7a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:42.087478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:42.141540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff359f1-cfb8-4319-9c63-387d92261a7a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:42.150295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d42eec-2223-4302-8956-0d8f1f273d55 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:42.173580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:42.182345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa209f-b137-4527-9b4a-2161da1a847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:42.182345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa209f-b137-4527-9b4a-2161da1a847d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:42.182345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa209f-b137-4527-9b4a-2161da1a847d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:42.182345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa209f-b137-4527-9b4a-2161da1a847d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:42.189502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa209f-b137-4527-9b4a-2161da1a847d None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=7973be0cfa9846afaef91c7ae1b190d2) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:42.189502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa209f-b137-4527-9b4a-2161da1a847d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:42.189502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa209f-b137-4527-9b4a-2161da1a847d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:42.192609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 343/684] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:42 2022] GET /identity/v3/role_assignments?user.id=7973be0cfa9846afaef91c7ae1b190d2&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:42.193499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa209f-b137-4527-9b4a-2161da1a847d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:42.194125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ba24-d99b-4f77-b571-377fd35825ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:42.194927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ba24-d99b-4f77-b571-377fd35825ff None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:42.195215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ba24-d99b-4f77-b571-377fd35825ff None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:42.195494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ba24-d99b-4f77-b571-377fd35825ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:42.208914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020ba24-d99b-4f77-b571-377fd35825ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-5020ba24-d99b-4f77-b571-377fd35825ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:42.217443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:42.218449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:42.219265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 342/685] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:42.224583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ba24-d99b-4f77-b571-377fd35825ff None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:42.361204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa209f-b137-4527-9b4a-2161da1a847d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:42.395949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:42.420330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a1c6-85e9-4cf6-803d-ea1df95e76fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:42.420898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ba24-d99b-4f77-b571-377fd35825ff None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:42.421351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a1c6-85e9-4cf6-803d-ea1df95e76fc None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:42.421433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a1c6-85e9-4cf6-803d-ea1df95e76fc None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:42.421655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a1c6-85e9-4cf6-803d-ea1df95e76fc None admin] PATH_INFO: `/v3/users/swift` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:42.436326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773a1c6-85e9-4cf6-803d-ea1df95e76fc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:42.438512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773a1c6-85e9-4cf6-803d-ea1df95e76fc None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-a773a1c6-85e9-4cf6-803d-ea1df95e76fc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:42.456733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:42.457696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:42.458638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 344/686] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:42.465268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a1c6-85e9-4cf6-803d-ea1df95e76fc None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:42.474609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8d84e-a431-46b6-9ef1-d4670daebd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:42.475329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8d84e-a431-46b6-9ef1-d4670daebd12 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:42.475613 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8d84e-a431-46b6-9ef1-d4670daebd12 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:42.475947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8d84e-a431-46b6-9ef1-d4670daebd12 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:42.476707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8d84e-a431-46b6-9ef1-d4670daebd12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:42.477018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8d84e-a431-46b6-9ef1-d4670daebd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:42.478983 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8d84e-a431-46b6-9ef1-d4670daebd12 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:42.491434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 343/687] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:42.497752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8d84e-a431-46b6-9ef1-d4670daebd12 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:42.539302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:42.579923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a1c6-85e9-4cf6-803d-ea1df95e76fc None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:42.608130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8d84e-a431-46b6-9ef1-d4670daebd12 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:42.618445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13283f21-a6d9-4518-81de-a9edb4cb15a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:42.619212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13283f21-a6d9-4518-81de-a9edb4cb15a8 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:42.619498 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13283f21-a6d9-4518-81de-a9edb4cb15a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:42.619798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13283f21-a6d9-4518-81de-a9edb4cb15a8 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:42.620743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13283f21-a6d9-4518-81de-a9edb4cb15a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:42.621050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13283f21-a6d9-4518-81de-a9edb4cb15a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:42.623339 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13283f21-a6d9-4518-81de-a9edb4cb15a8 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:42.649478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 345/688] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 16 00:20:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:42.656687 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13283f21-a6d9-4518-81de-a9edb4cb15a8 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:42.664230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c10c6-10bc-4417-9feb-6750e58c8f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:42.665032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c10c6-10bc-4417-9feb-6750e58c8f22 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:42.665311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c10c6-10bc-4417-9feb-6750e58c8f22 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:42.666405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c10c6-10bc-4417-9feb-6750e58c8f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:42.691320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c10c6-10bc-4417-9feb-6750e58c8f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:42.692821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c10c6-10bc-4417-9feb-6750e58c8f22 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:42.699018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-c62c10c6-10bc-4417-9feb-6750e58c8f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:42.727043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:42.729214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:42.731997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:42.731997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:42.731997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:42.731997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:42.731997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 344/689] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:42.737852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c10c6-10bc-4417-9feb-6750e58c8f22 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:42.774847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13283f21-a6d9-4518-81de-a9edb4cb15a8 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:42.810550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134df2e-78d5-4442-bb32-a36e0e6e7f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:42.811209 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134df2e-78d5-4442-bb32-a36e0e6e7f37 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:42.812967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134df2e-78d5-4442-bb32-a36e0e6e7f37 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:42.812967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134df2e-78d5-4442-bb32-a36e0e6e7f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:42.884486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134df2e-78d5-4442-bb32-a36e0e6e7f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:42.885927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134df2e-78d5-4442-bb32-a36e0e6e7f37 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:42.933239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:42.933561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:42.936439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c10c6-10bc-4417-9feb-6750e58c8f22 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:42.998515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38844751-5eae-4e53-89f2-2d2bf6653d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:42.999183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38844751-5eae-4e53-89f2-2d2bf6653d7b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:42.999466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38844751-5eae-4e53-89f2-2d2bf6653d7b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:42.999765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38844751-5eae-4e53-89f2-2d2bf6653d7b None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.001780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38844751-5eae-4e53-89f2-2d2bf6653d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:43.002091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38844751-5eae-4e53-89f2-2d2bf6653d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:43.003470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38844751-5eae-4e53-89f2-2d2bf6653d7b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:43.028291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 345/690] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:43.032812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38844751-5eae-4e53-89f2-2d2bf6653d7b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:43.061699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 346/691] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:43.074280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134df2e-78d5-4442-bb32-a36e0e6e7f37 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:43.149521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38844751-5eae-4e53-89f2-2d2bf6653d7b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:43.212455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a556a-c7a5-4919-96ea-62d2aba38a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:43.213273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a556a-c7a5-4919-96ea-62d2aba38a47 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:43.213558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a556a-c7a5-4919-96ea-62d2aba38a47 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:43.213837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a556a-c7a5-4919-96ea-62d2aba38a47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.223515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134df2e-78d5-4442-bb32-a36e0e6e7f37 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:43.244562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a556a-c7a5-4919-96ea-62d2aba38a47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:43.246039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a556a-c7a5-4919-96ea-62d2aba38a47 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:43.258164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5326f7-ef73-440c-8cc4-9484fb7d247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:43.259071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5326f7-ef73-440c-8cc4-9484fb7d247a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:43.259357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5326f7-ef73-440c-8cc4-9484fb7d247a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:43.259633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5326f7-ef73-440c-8cc4-9484fb7d247a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.270865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5326f7-ef73-440c-8cc4-9484fb7d247a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:43.272350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5326f7-ef73-440c-8cc4-9484fb7d247a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-1b9a556a-c7a5-4919-96ea-62d2aba38a47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:43.280417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:43.281305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:43.282237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:43.288187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 346/692] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 16 00:20:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-cb5326f7-ef73-440c-8cc4-9484fb7d247a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:43.290867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:43.292905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:43.295127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:43.295127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:43.295127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:43.295127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:43.295127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 347/693] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:43.296570 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:43.299708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a556a-c7a5-4919-96ea-62d2aba38a47 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:43.299951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5326f7-ef73-440c-8cc4-9484fb7d247a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:43.323957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:43.478418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a556a-c7a5-4919-96ea-62d2aba38a47 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:43.497997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5326f7-ef73-440c-8cc4-9484fb7d247a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:43.549123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a74f8-8c20-4ba8-80c0-2265b49c0daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:43.549794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a74f8-8c20-4ba8-80c0-2265b49c0daa None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:43.550076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a74f8-8c20-4ba8-80c0-2265b49c0daa None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:43.550351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a74f8-8c20-4ba8-80c0-2265b49c0daa None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.551071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a74f8-8c20-4ba8-80c0-2265b49c0daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:43.551378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a74f8-8c20-4ba8-80c0-2265b49c0daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:43.552778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a74f8-8c20-4ba8-80c0-2265b49c0daa None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:43.557355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e131bc-060f-4ece-9983-925589ef59a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:43.558029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e131bc-060f-4ece-9983-925589ef59a3 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:43.558313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e131bc-060f-4ece-9983-925589ef59a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:43.558589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e131bc-060f-4ece-9983-925589ef59a3 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.560007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e131bc-060f-4ece-9983-925589ef59a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:43.560278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e131bc-060f-4ece-9983-925589ef59a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:43.561686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e131bc-060f-4ece-9983-925589ef59a3 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:43.580063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 347/694] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:43.585342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a74f8-8c20-4ba8-80c0-2265b49c0daa None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:43.597921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 348/695] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 16 00:20:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:43.604373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e131bc-060f-4ece-9983-925589ef59a3 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:43.672574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:43.711350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:43.764299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e131bc-060f-4ece-9983-925589ef59a3 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:43.768381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a74f8-8c20-4ba8-80c0-2265b49c0daa None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:43.821013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8997f96-ec50-4aa2-900c-ccc41cbb484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:43.822011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8997f96-ec50-4aa2-900c-ccc41cbb484e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:43.822152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8997f96-ec50-4aa2-900c-ccc41cbb484e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:43.822355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8997f96-ec50-4aa2-900c-ccc41cbb484e None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.829646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8997f96-ec50-4aa2-900c-ccc41cbb484e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:43.831871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8997f96-ec50-4aa2-900c-ccc41cbb484e None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:43.836423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39193-d857-4cab-b2c5-190cb2a8cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:43.837190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39193-d857-4cab-b2c5-190cb2a8cad6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:43.837601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39193-d857-4cab-b2c5-190cb2a8cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:43.837972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39193-d857-4cab-b2c5-190cb2a8cad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-a8997f96-ec50-4aa2-900c-ccc41cbb484e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:43.846703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:43.847807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:43.848726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:43.848726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:43.848726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:43.848726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:43.848726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:43.848726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:43.848726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:43.848726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:43.851068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 348/696] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:43.858692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8997f96-ec50-4aa2-900c-ccc41cbb484e None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:43.924691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39193-d857-4cab-b2c5-190cb2a8cad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:43.926403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39193-d857-4cab-b2c5-190cb2a8cad6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:43.987509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:44.021526 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8997f96-ec50-4aa2-900c-ccc41cbb484e None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:44.051845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 349/697] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:20:44.051845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d410e2-8fb7-4c8c-b217-12baf56ec8fb None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.051845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d410e2-8fb7-4c8c-b217-12baf56ec8fb None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.051845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d410e2-8fb7-4c8c-b217-12baf56ec8fb None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.051845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 350/698] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:44.053335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45caa6b-332f-4f46-b98f-cc5747c8c798 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.053620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45caa6b-332f-4f46-b98f-cc5747c8c798 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.053893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45caa6b-332f-4f46-b98f-cc5747c8c798 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.055273 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 351/699] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:44.057930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45caa6b-332f-4f46-b98f-cc5747c8c798 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:44.065830 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:44.072955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba2a7d-0a76-4182-bd61-0511e9c5302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:44.073620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2a7d-0a76-4182-bd61-0511e9c5302c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.073897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2a7d-0a76-4182-bd61-0511e9c5302c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.074190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2a7d-0a76-4182-bd61-0511e9c5302c None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.075258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba2a7d-0a76-4182-bd61-0511e9c5302c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:44.075369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba2a7d-0a76-4182-bd61-0511e9c5302c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:44.076811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba2a7d-0a76-4182-bd61-0511e9c5302c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:44.088484 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 349/700] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:44.089612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71759080-9354-491d-a1e7-f496517c4d96 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.089900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71759080-9354-491d-a1e7-f496517c4d96 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.090206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71759080-9354-491d-a1e7-f496517c4d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.107691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-71759080-9354-491d-a1e7-f496517c4d96 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:44.108891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-71759080-9354-491d-a1e7-f496517c4d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:44.174227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45caa6b-332f-4f46-b98f-cc5747c8c798 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:44.178554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 350/701] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:44.180017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351b48-c68a-4af2-b857-b365429560ae None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.180425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351b48-c68a-4af2-b857-b365429560ae None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.180759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351b48-c68a-4af2-b857-b365429560ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.198365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-01351b48-c68a-4af2-b857-b365429560ae None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:44.199773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-01351b48-c68a-4af2-b857-b365429560ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:44.216324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e63653-83b1-40a2-bece-2c8d19eb9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:44.217357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63653-83b1-40a2-bece-2c8d19eb9401 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.217876 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63653-83b1-40a2-bece-2c8d19eb9401 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.218481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63653-83b1-40a2-bece-2c8d19eb9401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.229494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63653-83b1-40a2-bece-2c8d19eb9401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:44.231704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63653-83b1-40a2-bece-2c8d19eb9401 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:44.234215 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e6e63653-83b1-40a2-bece-2c8d19eb9401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:44.250775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:44.251688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:44.252620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:44.252620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:44.252620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:44.252620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:44.257058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 352/702] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:44.257599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e63653-83b1-40a2-bece-2c8d19eb9401 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:44.279831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 351/703] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:44.279831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01351b48-c68a-4af2-b857-b365429560ae None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:44.330158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:44.372581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e63653-83b1-40a2-bece-2c8d19eb9401 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:44.381916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01351b48-c68a-4af2-b857-b365429560ae None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:44.412442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11068999-775d-47df-b5f5-5c6071ef6efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:44.414011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11068999-775d-47df-b5f5-5c6071ef6efb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.414766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11068999-775d-47df-b5f5-5c6071ef6efb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.415279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11068999-775d-47df-b5f5-5c6071ef6efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.416400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11068999-775d-47df-b5f5-5c6071ef6efb None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=e7ccca2836bc4004bcf39a3070b6c54f) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:44.416965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11068999-775d-47df-b5f5-5c6071ef6efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:44.418823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4efcb9-463c-46d8-bb58-7f4782b3c3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:44.419479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11068999-775d-47df-b5f5-5c6071ef6efb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:44.419609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4efcb9-463c-46d8-bb58-7f4782b3c3f6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.419890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4efcb9-463c-46d8-bb58-7f4782b3c3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.420159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4efcb9-463c-46d8-bb58-7f4782b3c3f6 None admin] PATH_INFO: `/v3/services/network` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.421189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4efcb9-463c-46d8-bb58-7f4782b3c3f6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:44.422547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4efcb9-463c-46d8-bb58-7f4782b3c3f6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:44.428165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 353/704] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:44 2022] GET /identity/v3/role_assignments?user.id=e7ccca2836bc4004bcf39a3070b6c54f&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:44.429236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11068999-775d-47df-b5f5-5c6071ef6efb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-7d4efcb9-463c-46d8-bb58-7f4782b3c3f6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:44.436497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:44.437584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:20:44.438438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:44.442593 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 352/705] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:44 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:44.443929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4efcb9-463c-46d8-bb58-7f4782b3c3f6 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:44.523518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:44.559185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4efcb9-463c-46d8-bb58-7f4782b3c3f6 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:44.575990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:44.583903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11068999-775d-47df-b5f5-5c6071ef6efb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:44.611349 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a028f95-1d6d-4434-a44f-7745d3d9ff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:44.611582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a028f95-1d6d-4434-a44f-7745d3d9ff6f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.611900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a028f95-1d6d-4434-a44f-7745d3d9ff6f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.612148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a028f95-1d6d-4434-a44f-7745d3d9ff6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.630488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a028f95-1d6d-4434-a44f-7745d3d9ff6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:44.632363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a028f95-1d6d-4434-a44f-7745d3d9ff6f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:44.633248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a1683-69aa-4c40-a009-321971bcda1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:44.633929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1683-69aa-4c40-a009-321971bcda1e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.634216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1683-69aa-4c40-a009-321971bcda1e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.634499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1683-69aa-4c40-a009-321971bcda1e None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.635225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a1683-69aa-4c40-a009-321971bcda1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:44.635544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a1683-69aa-4c40-a009-321971bcda1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:44.637524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a1683-69aa-4c40-a009-321971bcda1e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:44.651562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 354/706] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:44.652253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a1683-69aa-4c40-a009-321971bcda1e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-1a028f95-1d6d-4434-a44f-7745d3d9ff6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:44.652438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:44.653907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:44.654767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:44.654767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:44.654767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:44.654767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:44.659013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 353/707] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:44.660424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a028f95-1d6d-4434-a44f-7745d3d9ff6f None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:44.784478 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a028f95-1d6d-4434-a44f-7745d3d9ff6f None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:44.796035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a1683-69aa-4c40-a009-321971bcda1e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:44.817662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:44.832425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707299-96cc-44f8-8c2e-491204d35142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:44.836070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461ffbd-b9c1-481b-aaf2-cb7b64b89d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:44.836070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461ffbd-b9c1-481b-aaf2-cb7b64b89d5a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.836300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707299-96cc-44f8-8c2e-491204d35142 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:44.836393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461ffbd-b9c1-481b-aaf2-cb7b64b89d5a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.836472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707299-96cc-44f8-8c2e-491204d35142 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:44.836554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461ffbd-b9c1-481b-aaf2-cb7b64b89d5a None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.836635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707299-96cc-44f8-8c2e-491204d35142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:44.836724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461ffbd-b9c1-481b-aaf2-cb7b64b89d5a None admin] RBAC: Adding query filter params (name=network) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:44.836724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461ffbd-b9c1-481b-aaf2-cb7b64b89d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:44.836952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461ffbd-b9c1-481b-aaf2-cb7b64b89d5a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:44.843412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31707299-96cc-44f8-8c2e-491204d35142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:44.845070 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31707299-96cc-44f8-8c2e-491204d35142 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:44.847230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 355/708] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:20:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:44.848244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461ffbd-b9c1-481b-aaf2-cb7b64b89d5a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-31707299-96cc-44f8-8c2e-491204d35142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:44.863197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:44.870384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 354/709] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:44.871353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707299-96cc-44f8-8c2e-491204d35142 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:44.905350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:44.967750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461ffbd-b9c1-481b-aaf2-cb7b64b89d5a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:44.998595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707299-96cc-44f8-8c2e-491204d35142 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:45.011771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c3f0-9223-417b-b945-edfacee7dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:45.013049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c3f0-9223-417b-b945-edfacee7dcea None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.013329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c3f0-9223-417b-b945-edfacee7dcea None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.013602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c3f0-9223-417b-b945-edfacee7dcea None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.014327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363c3f0-9223-417b-b945-edfacee7dcea None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:45.014616 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363c3f0-9223-417b-b945-edfacee7dcea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:45.016074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363c3f0-9223-417b-b945-edfacee7dcea None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:45.029205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 356/710] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:45.030135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c3f0-9223-417b-b945-edfacee7dcea None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:45.037876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade0fd7-51a8-4ceb-a81e-652f5c60c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:45.038555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade0fd7-51a8-4ceb-a81e-652f5c60c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.038842 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade0fd7-51a8-4ceb-a81e-652f5c60c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.039122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade0fd7-51a8-4ceb-a81e-652f5c60c1e5 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.040003 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade0fd7-51a8-4ceb-a81e-652f5c60c1e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:45.040290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade0fd7-51a8-4ceb-a81e-652f5c60c1e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:45.041682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade0fd7-51a8-4ceb-a81e-652f5c60c1e5 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:45.051774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 355/711] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:20:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:45.051774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e527eea-713e-4e31-aba6-ea3f07f17118 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.051774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e527eea-713e-4e31-aba6-ea3f07f17118 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.051774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e527eea-713e-4e31-aba6-ea3f07f17118 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.051774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 356/712] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:45.051774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e527eea-713e-4e31-aba6-ea3f07f17118 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:45.089949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:45.149775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c3f0-9223-417b-b945-edfacee7dcea None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:45.195287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:45.195490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd803cd-b6cb-4bec-b20a-50485fa41165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:45.196065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd803cd-b6cb-4bec-b20a-50485fa41165 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.196331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd803cd-b6cb-4bec-b20a-50485fa41165 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.196633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd803cd-b6cb-4bec-b20a-50485fa41165 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.197471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd803cd-b6cb-4bec-b20a-50485fa41165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:45.198121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd803cd-b6cb-4bec-b20a-50485fa41165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:45.199315 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd803cd-b6cb-4bec-b20a-50485fa41165 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:45.211810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e527eea-713e-4e31-aba6-ea3f07f17118 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:45.219806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 357/713] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:45.219806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50f34b-3484-4660-b0c0-a7c8a3d18dae None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.219806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50f34b-3484-4660-b0c0-a7c8a3d18dae None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.219806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50f34b-3484-4660-b0c0-a7c8a3d18dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.238872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-5f50f34b-3484-4660-b0c0-a7c8a3d18dae None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:45.240200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5f50f34b-3484-4660-b0c0-a7c8a3d18dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:45.255139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33a4a4-5976-49be-b518-87cad2b9161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:45.255837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33a4a4-5976-49be-b518-87cad2b9161f None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.256288 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33a4a4-5976-49be-b518-87cad2b9161f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.256823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33a4a4-5976-49be-b518-87cad2b9161f None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.257920 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33a4a4-5976-49be-b518-87cad2b9161f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:45.259817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33a4a4-5976-49be-b518-87cad2b9161f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:45.316881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 358/714] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:45.320100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50f34b-3484-4660-b0c0-a7c8a3d18dae None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:45.358723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 357/715] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:20:45 2022] POST /identity/v3/users => generated 254 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:20:45.359892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33a4a4-5976-49be-b518-87cad2b9161f None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:45.374203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:45.514057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33a4a4-5976-49be-b518-87cad2b9161f None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:45.537987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50f34b-3484-4660-b0c0-a7c8a3d18dae None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:45.561175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808fea-3ebb-4964-9cd5-f72971d1249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:45.562714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808fea-3ebb-4964-9cd5-f72971d1249d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.563235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808fea-3ebb-4964-9cd5-f72971d1249d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.563724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808fea-3ebb-4964-9cd5-f72971d1249d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.565004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90808fea-3ebb-4964-9cd5-f72971d1249d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:45.566926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90808fea-3ebb-4964-9cd5-f72971d1249d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-90808fea-3ebb-4964-9cd5-f72971d1249d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:45.581725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:45.582718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:20:45.583626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:45.587208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 358/716] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Jun 16 00:20:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:45.594093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808fea-3ebb-4964-9cd5-f72971d1249d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:45.610498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:45.623365 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d93c2-1cc5-485a-bcfb-d49b3fdcf2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:45.623977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d93c2-1cc5-485a-bcfb-d49b3fdcf2f9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.624265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d93c2-1cc5-485a-bcfb-d49b3fdcf2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.624542 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d93c2-1cc5-485a-bcfb-d49b3fdcf2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.625396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d93c2-1cc5-485a-bcfb-d49b3fdcf2f9 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=ba29f9c029fe4390af3b6ce1b2147ce9) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:45.625697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d93c2-1cc5-485a-bcfb-d49b3fdcf2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:45.627116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d93c2-1cc5-485a-bcfb-d49b3fdcf2f9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:45.635260 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 359/717] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:45 2022] GET /identity/v3/role_assignments?user.id=ba29f9c029fe4390af3b6ce1b2147ce9&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=635caa85d8524fb887206fd521defd3f => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:45.719274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808fea-3ebb-4964-9cd5-f72971d1249d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:45.759317 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1c68d-3d07-40e4-bd93-11805130fffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:45.760408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1c68d-3d07-40e4-bd93-11805130fffe None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.760900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1c68d-3d07-40e4-bd93-11805130fffe None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.761398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1c68d-3d07-40e4-bd93-11805130fffe None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.762369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1c68d-3d07-40e4-bd93-11805130fffe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:45.762919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1c68d-3d07-40e4-bd93-11805130fffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:45.764585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1c68d-3d07-40e4-bd93-11805130fffe None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:45.770457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 359/718] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 16 00:20:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:45.776455 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d93c2-1cc5-485a-bcfb-d49b3fdcf2f9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:45.884640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:45.889416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d93c2-1cc5-485a-bcfb-d49b3fdcf2f9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:45.925515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862abb1-3b13-4e37-96c6-e2a6ea7f1137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:45.926605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862abb1-3b13-4e37-96c6-e2a6ea7f1137 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.927093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862abb1-3b13-4e37-96c6-e2a6ea7f1137 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.927617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862abb1-3b13-4e37-96c6-e2a6ea7f1137 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.928635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862abb1-3b13-4e37-96c6-e2a6ea7f1137 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:45.929145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862abb1-3b13-4e37-96c6-e2a6ea7f1137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:45.930869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862abb1-3b13-4e37-96c6-e2a6ea7f1137 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:45.937239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 360/719] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 16 00:20:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:46.783095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52aa3c-b70e-422f-baeb-57b1b878c2f5 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:46.783637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52aa3c-b70e-422f-baeb-57b1b878c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:46.783637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52aa3c-b70e-422f-baeb-57b1b878c2f5 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:46.785301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 360/720] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:46.790165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09945e-ce2d-4e01-b5a1-851aac9b0366 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:46.790590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09945e-ce2d-4e01-b5a1-851aac9b0366 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:46.790790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09945e-ce2d-4e01-b5a1-851aac9b0366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:46.812766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3b09945e-ce2d-4e01-b5a1-851aac9b0366 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:46.814059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3b09945e-ce2d-4e01-b5a1-851aac9b0366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:46.883896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 361/721] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:46.919080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52aa3c-b70e-422f-baeb-57b1b878c2f5 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:47.020101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:47.052233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52aa3c-b70e-422f-baeb-57b1b878c2f5 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:47.106332 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab5536-0394-4509-a815-53e2d9773e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:47.107135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab5536-0394-4509-a815-53e2d9773e36 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.107415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab5536-0394-4509-a815-53e2d9773e36 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.107689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab5536-0394-4509-a815-53e2d9773e36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.126666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab5536-0394-4509-a815-53e2d9773e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-fcab5536-0394-4509-a815-53e2d9773e36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:47.134553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:47.135480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:47.136343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 361/722] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:47.142176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09945e-ce2d-4e01-b5a1-851aac9b0366 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:47.288764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:47.297929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09945e-ce2d-4e01-b5a1-851aac9b0366 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:47.350568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8782ac-39c7-41cc-826f-218eb4dc9b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:47.351256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8782ac-39c7-41cc-826f-218eb4dc9b67 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.351534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8782ac-39c7-41cc-826f-218eb4dc9b67 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.351829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8782ac-39c7-41cc-826f-218eb4dc9b67 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.352584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8782ac-39c7-41cc-826f-218eb4dc9b67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:47.352887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8782ac-39c7-41cc-826f-218eb4dc9b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:47.354270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8782ac-39c7-41cc-826f-218eb4dc9b67 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:47.368021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 362/723] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:47.373661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab5536-0394-4509-a815-53e2d9773e36 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:47.414934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d56ac4-9558-4c95-b1f2-0a93bc79e18f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.415275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d56ac4-9558-4c95-b1f2-0a93bc79e18f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.415479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d56ac4-9558-4c95-b1f2-0a93bc79e18f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.416982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 363/724] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:47.423431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b565e-47b0-47bd-836f-b5bff0f041c7 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.423717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b565e-47b0-47bd-836f-b5bff0f041c7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.424015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b565e-47b0-47bd-836f-b5bff0f041c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.448846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-249b565e-47b0-47bd-836f-b5bff0f041c7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:47.450077 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-249b565e-47b0-47bd-836f-b5bff0f041c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:47.557725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab5536-0394-4509-a815-53e2d9773e36 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:47.574995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 364/725] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:20:47.600191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb37bb-c6b2-455f-bd3f-f1d8a5c7ffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:47.601315 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb37bb-c6b2-455f-bd3f-f1d8a5c7ffb4 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.601824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb37bb-c6b2-455f-bd3f-f1d8a5c7ffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.602310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb37bb-c6b2-455f-bd3f-f1d8a5c7ffb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.604477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b565e-47b0-47bd-836f-b5bff0f041c7 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:47.612948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:47.628203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb37bb-c6b2-455f-bd3f-f1d8a5c7ffb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:47.634091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb37bb-c6b2-455f-bd3f-f1d8a5c7ffb4 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-3bcb37bb-c6b2-455f-bd3f-f1d8a5c7ffb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:47.664424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:47.665347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:47.666213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:47.666213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:47.666213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:47.666213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:47.668524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 362/726] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:47.674991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb37bb-c6b2-455f-bd3f-f1d8a5c7ffb4 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:47.745790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:47.774230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b565e-47b0-47bd-836f-b5bff0f041c7 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:47.834818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bc65b-68b0-414d-b0e0-012eaef842ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:47.836250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bc65b-68b0-414d-b0e0-012eaef842ad None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.837754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bc65b-68b0-414d-b0e0-012eaef842ad None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.838245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bc65b-68b0-414d-b0e0-012eaef842ad None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.839144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bc65b-68b0-414d-b0e0-012eaef842ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:47.841965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bc65b-68b0-414d-b0e0-012eaef842ad None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:47.851625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb37bb-c6b2-455f-bd3f-f1d8a5c7ffb4 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:47.889221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485a989-d134-4176-b7d7-89ce46ce978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:47.890273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a989-d134-4176-b7d7-89ce46ce978c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.890798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a989-d134-4176-b7d7-89ce46ce978c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.891304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a989-d134-4176-b7d7-89ce46ce978c None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.892358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a989-d134-4176-b7d7-89ce46ce978c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:47.892950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a989-d134-4176-b7d7-89ce46ce978c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:47.894578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a989-d134-4176-b7d7-89ce46ce978c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:47.908576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 363/727] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:47.914097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485a989-d134-4176-b7d7-89ce46ce978c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:47.941717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 365/728] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:20:47 2022] POST /identity/v3/services => generated 240 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:20:47.972874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:48.029853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485a989-d134-4176-b7d7-89ce46ce978c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:48.073129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d736f-2309-4292-9688-d49b7ca70eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:48.073928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d736f-2309-4292-9688-d49b7ca70eb7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.074205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d736f-2309-4292-9688-d49b7ca70eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.075094 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d736f-2309-4292-9688-d49b7ca70eb7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.083474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d736f-2309-4292-9688-d49b7ca70eb7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:48.085024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d736f-2309-4292-9688-d49b7ca70eb7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-fe0d736f-2309-4292-9688-d49b7ca70eb7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:48.109101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:48.110106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:48.111021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 364/729] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:48.116202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bc65b-68b0-414d-b0e0-012eaef842ad None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:48.255386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bc65b-68b0-414d-b0e0-012eaef842ad None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:48.292659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8981ba-508e-4364-8c19-82d37239657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:48.293858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8981ba-508e-4364-8c19-82d37239657e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.294137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8981ba-508e-4364-8c19-82d37239657e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.294406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8981ba-508e-4364-8c19-82d37239657e None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.295229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8981ba-508e-4364-8c19-82d37239657e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:48.295534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8981ba-508e-4364-8c19-82d37239657e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:48.297002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8981ba-508e-4364-8c19-82d37239657e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:48.308750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c33bdb-600f-4173-858a-4847c8b5884c None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.309863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c33bdb-600f-4173-858a-4847c8b5884c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.310341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c33bdb-600f-4173-858a-4847c8b5884c None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.312198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 365/730] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:48.318018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657c19a-b1a0-406c-848b-3b921e303082 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.318558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657c19a-b1a0-406c-848b-3b921e303082 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.318991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 366/731] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 16 00:20:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:48.319262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657c19a-b1a0-406c-848b-3b921e303082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.324557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8981ba-508e-4364-8c19-82d37239657e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:48.328181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:48.350248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c657c19a-b1a0-406c-848b-3b921e303082 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:48.350248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c657c19a-b1a0-406c-848b-3b921e303082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:48.448949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 366/732] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:48 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:20:48.455759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4307b9c-a7b4-4e6b-af1b-92d101a68f9e None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.455759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4307b9c-a7b4-4e6b-af1b-92d101a68f9e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.455759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4307b9c-a7b4-4e6b-af1b-92d101a68f9e None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.455759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 367/733] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:48.458924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b854-2e39-4f1f-a555-a9cc669547ba None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.459417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b854-2e39-4f1f-a555-a9cc669547ba None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.459935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b854-2e39-4f1f-a555-a9cc669547ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.477669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-b4e8b854-2e39-4f1f-a555-a9cc669547ba None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:48.477962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8981ba-508e-4364-8c19-82d37239657e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:48.479580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b4e8b854-2e39-4f1f-a555-a9cc669547ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:48.520089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:48.524325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c122e8-bfb3-4ff2-8a7f-208fbb72aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:48.525114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c122e8-bfb3-4ff2-8a7f-208fbb72aa7b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.525501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c122e8-bfb3-4ff2-8a7f-208fbb72aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.525879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c122e8-bfb3-4ff2-8a7f-208fbb72aa7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.570891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 368/734] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:48 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:48.572110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b854-2e39-4f1f-a555-a9cc669547ba None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:48.624928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c122e8-bfb3-4ff2-8a7f-208fbb72aa7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:48.626906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c122e8-bfb3-4ff2-8a7f-208fbb72aa7b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:48.629467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:48.685521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b854-2e39-4f1f-a555-a9cc669547ba None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:48.731847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de428f-7602-458b-89a6-87adaa5eeedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:48.732661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de428f-7602-458b-89a6-87adaa5eeedc None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.732942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de428f-7602-458b-89a6-87adaa5eeedc None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.733217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de428f-7602-458b-89a6-87adaa5eeedc None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.744335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de428f-7602-458b-89a6-87adaa5eeedc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:48.747559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 367/735] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:48 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:48.751334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c122e8-bfb3-4ff2-8a7f-208fbb72aa7b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-f8de428f-7602-458b-89a6-87adaa5eeedc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:48.752528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:48.753439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:48.754258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:48.758735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 369/736] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:48.759950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71f831-188d-4b73-a137-66eab820c919 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.760248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71f831-188d-4b73-a137-66eab820c919 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.760528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71f831-188d-4b73-a137-66eab820c919 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.765950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 370/737] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:48.765950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71f831-188d-4b73-a137-66eab820c919 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:48.788929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:48.855388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c122e8-bfb3-4ff2-8a7f-208fbb72aa7b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:48.857991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:48.870819 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71f831-188d-4b73-a137-66eab820c919 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:48.891811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb204e8-6d38-45af-8f6a-1756fef4417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:48.893263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb204e8-6d38-45af-8f6a-1756fef4417c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.893547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb204e8-6d38-45af-8f6a-1756fef4417c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.893825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb204e8-6d38-45af-8f6a-1756fef4417c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.904275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb204e8-6d38-45af-8f6a-1756fef4417c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:48.907023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef5c18-eab3-4a8c-a4c2-a176de8a2320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:48.907857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef5c18-eab3-4a8c-a4c2-a176de8a2320 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.908145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef5c18-eab3-4a8c-a4c2-a176de8a2320 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.908423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef5c18-eab3-4a8c-a4c2-a176de8a2320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-1eb204e8-6d38-45af-8f6a-1756fef4417c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:48.911797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:48.912797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:48.913623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:48.918114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 368/738] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:48.919446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb204e8-6d38-45af-8f6a-1756fef4417c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:48.919962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef5c18-eab3-4a8c-a4c2-a176de8a2320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:48.921449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef5c18-eab3-4a8c-a4c2-a176de8a2320 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-9bef5c18-eab3-4a8c-a4c2-a176de8a2320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:48.940174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:48.941068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:48.941942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:48.941942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:48.941942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:48.941942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:48.941942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 371/739] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:48.942640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df0a6b-bb49-48c6-9643-1567ecd70c0a None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.942924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df0a6b-bb49-48c6-9643-1567ecd70c0a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.943199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df0a6b-bb49-48c6-9643-1567ecd70c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.960451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-15df0a6b-bb49-48c6-9643-1567ecd70c0a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:48.961645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-15df0a6b-bb49-48c6-9643-1567ecd70c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:49.037318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb204e8-6d38-45af-8f6a-1756fef4417c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.041345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 372/740] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:48 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:20:49.042389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df0a6b-bb49-48c6-9643-1567ecd70c0a None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.046979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.088034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04ecaf-3142-4802-9f4f-d611541d422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.088810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04ecaf-3142-4802-9f4f-d611541d422f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.089093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04ecaf-3142-4802-9f4f-d611541d422f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.089371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04ecaf-3142-4802-9f4f-d611541d422f None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.090729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04ecaf-3142-4802-9f4f-d611541d422f None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:49.091036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04ecaf-3142-4802-9f4f-d611541d422f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.092429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04ecaf-3142-4802-9f4f-d611541d422f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.103893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 369/741] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:49.104821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04ecaf-3142-4802-9f4f-d611541d422f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.130374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.156931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df0a6b-bb49-48c6-9643-1567ecd70c0a None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.193074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164b2b-45ea-4009-bcd4-d2efbf343e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.193854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164b2b-45ea-4009-bcd4-d2efbf343e62 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.194139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164b2b-45ea-4009-bcd4-d2efbf343e62 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.194423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4164b2b-45ea-4009-bcd4-d2efbf343e62 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.195157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4164b2b-45ea-4009-bcd4-d2efbf343e62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:49.195465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4164b2b-45ea-4009-bcd4-d2efbf343e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.197124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4164b2b-45ea-4009-bcd4-d2efbf343e62 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.205631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04ecaf-3142-4802-9f4f-d611541d422f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.210393 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 373/742] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:49.211276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164b2b-45ea-4009-bcd4-d2efbf343e62 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.238311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661e4f5-e225-441c-8116-3cfaea271b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.238962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661e4f5-e225-441c-8116-3cfaea271b88 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.239242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661e4f5-e225-441c-8116-3cfaea271b88 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.239522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661e4f5-e225-441c-8116-3cfaea271b88 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.240259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661e4f5-e225-441c-8116-3cfaea271b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:49.240563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661e4f5-e225-441c-8116-3cfaea271b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.241918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661e4f5-e225-441c-8116-3cfaea271b88 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.257907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 370/743] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:49.257907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661e4f5-e225-441c-8116-3cfaea271b88 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.284416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.321755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4164b2b-45ea-4009-bcd4-d2efbf343e62 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.339580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.358529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661e4f5-e225-441c-8116-3cfaea271b88 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.360395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee3c6-aab2-4b07-a746-9cc28acd31f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.361067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee3c6-aab2-4b07-a746-9cc28acd31f1 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.361351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee3c6-aab2-4b07-a746-9cc28acd31f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.361634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee3c6-aab2-4b07-a746-9cc28acd31f1 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.362347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee3c6-aab2-4b07-a746-9cc28acd31f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.363813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee3c6-aab2-4b07-a746-9cc28acd31f1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.393948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c1822-6a8b-4b14-b3e0-c026d28be4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.394736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c1822-6a8b-4b14-b3e0-c026d28be4c6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.395015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c1822-6a8b-4b14-b3e0-c026d28be4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.395287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c1822-6a8b-4b14-b3e0-c026d28be4c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.406048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c1822-6a8b-4b14-b3e0-c026d28be4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.407619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c1822-6a8b-4b14-b3e0-c026d28be4c6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.410866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 374/744] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:20:49 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:20:49.420908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee3c6-aab2-4b07-a746-9cc28acd31f1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-611c1822-6a8b-4b14-b3e0-c026d28be4c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:49.426358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:49.427368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:49.428355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:49.428355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:49.428355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:49.428355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:49.428355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 371/745] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:49.428627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c1822-6a8b-4b14-b3e0-c026d28be4c6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.545815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c1822-6a8b-4b14-b3e0-c026d28be4c6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.590456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee3c6-aab2-4b07-a746-9cc28acd31f1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.591815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.601748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25cc1f-acde-4fb2-8775-b1d195f98b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.603245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25cc1f-acde-4fb2-8775-b1d195f98b94 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.603759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25cc1f-acde-4fb2-8775-b1d195f98b94 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.604506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25cc1f-acde-4fb2-8775-b1d195f98b94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.615034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25cc1f-acde-4fb2-8775-b1d195f98b94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.616523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25cc1f-acde-4fb2-8775-b1d195f98b94 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.617266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.634083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb34c2-425a-453f-b77c-3f785cb25aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.634861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb34c2-425a-453f-b77c-3f785cb25aa8 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.635148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb34c2-425a-453f-b77c-3f785cb25aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.635419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb34c2-425a-453f-b77c-3f785cb25aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-3f25cc1f-acde-4fb2-8775-b1d195f98b94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:49.635511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:49.636411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:49.637857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:49.637857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:49.637857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:49.637857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:49.637857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:49.637857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:49.637857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:49.637857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:49.637857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 372/746] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:49.641005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25cc1f-acde-4fb2-8775-b1d195f98b94 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.656371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb34c2-425a-453f-b77c-3f785cb25aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.657908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb34c2-425a-453f-b77c-3f785cb25aa8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b0bb34c2-425a-453f-b77c-3f785cb25aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:49.686388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:49.689704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:49.690592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:49.690592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:49.690592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:49.690592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:49.694725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 375/747] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:49.694725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb34c2-425a-453f-b77c-3f785cb25aa8 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.771281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25cc1f-acde-4fb2-8775-b1d195f98b94 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.797719 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb34c2-425a-453f-b77c-3f785cb25aa8 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.816015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fce150-efa5-4ad4-ac16-f81d47a679c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.817066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fce150-efa5-4ad4-ac16-f81d47a679c1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.817415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fce150-efa5-4ad4-ac16-f81d47a679c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.817702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fce150-efa5-4ad4-ac16-f81d47a679c1 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.818428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fce150-efa5-4ad4-ac16-f81d47a679c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:49.818737 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fce150-efa5-4ad4-ac16-f81d47a679c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.820758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fce150-efa5-4ad4-ac16-f81d47a679c1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.835031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9f918-d26b-4c0e-8685-1b1542afd685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.835841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9f918-d26b-4c0e-8685-1b1542afd685 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.836125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9f918-d26b-4c0e-8685-1b1542afd685 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.836397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9f918-d26b-4c0e-8685-1b1542afd685 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.839048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 373/748] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:49.839215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9f918-d26b-4c0e-8685-1b1542afd685 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:49.839354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fce150-efa5-4ad4-ac16-f81d47a679c1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.839483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9f918-d26b-4c0e-8685-1b1542afd685 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.839483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9f918-d26b-4c0e-8685-1b1542afd685 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.857227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 376/749] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:49.858171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9f918-d26b-4c0e-8685-1b1542afd685 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.894612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.907219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.958912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fce150-efa5-4ad4-ac16-f81d47a679c1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.963122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9f918-d26b-4c0e-8685-1b1542afd685 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.997096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648b20-c3a5-4863-a9d3-5f7d05e521ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.998117 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648b20-c3a5-4863-a9d3-5f7d05e521ff None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.998581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648b20-c3a5-4863-a9d3-5f7d05e521ff None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.999026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48e17c-a126-4e80-8710-e836add6b414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.999217 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648b20-c3a5-4863-a9d3-5f7d05e521ff None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.000146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648b20-c3a5-4863-a9d3-5f7d05e521ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:50.000253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48e17c-a126-4e80-8710-e836add6b414 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.000542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48e17c-a126-4e80-8710-e836add6b414 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.000885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48e17c-a126-4e80-8710-e836add6b414 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.001112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648b20-c3a5-4863-a9d3-5f7d05e521ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.002678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648b20-c3a5-4863-a9d3-5f7d05e521ff None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.008760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48e17c-a126-4e80-8710-e836add6b414 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.010463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48e17c-a126-4e80-8710-e836add6b414 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.020209 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 374/750] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:50.021317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648b20-c3a5-4863-a9d3-5f7d05e521ff None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-9c48e17c-a126-4e80-8710-e836add6b414 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:50.025799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:50.026722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:50.027758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 377/751] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:50.028360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48e17c-a126-4e80-8710-e836add6b414 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.124266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:50.131037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48e17c-a126-4e80-8710-e836add6b414 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:50.135546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648b20-c3a5-4863-a9d3-5f7d05e521ff None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:50.160110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:50.166557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2068ea-67df-42ff-96f6-ea0f58f4c324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:50.167456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2068ea-67df-42ff-96f6-ea0f58f4c324 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.167884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2068ea-67df-42ff-96f6-ea0f58f4c324 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.168877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2068ea-67df-42ff-96f6-ea0f58f4c324 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.173777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1fe29-ddf0-4e84-ba9c-b7af0259895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:50.174600 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1fe29-ddf0-4e84-ba9c-b7af0259895e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.175046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1fe29-ddf0-4e84-ba9c-b7af0259895e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.175483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1fe29-ddf0-4e84-ba9c-b7af0259895e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.176480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1fe29-ddf0-4e84-ba9c-b7af0259895e None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=e7ccca2836bc4004bcf39a3070b6c54f) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:50.176989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1fe29-ddf0-4e84-ba9c-b7af0259895e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.177717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2068ea-67df-42ff-96f6-ea0f58f4c324 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.178730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1fe29-ddf0-4e84-ba9c-b7af0259895e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.192144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2068ea-67df-42ff-96f6-ea0f58f4c324 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.192376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 375/752] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/role_assignments?user.id=e7ccca2836bc4004bcf39a3070b6c54f&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=635caa85d8524fb887206fd521defd3f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:50.193532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1fe29-ddf0-4e84-ba9c-b7af0259895e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-3b2068ea-67df-42ff-96f6-ea0f58f4c324 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:50.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:50.195196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:50.196241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 378/753] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:50.201858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2068ea-67df-42ff-96f6-ea0f58f4c324 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.329060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1fe29-ddf0-4e84-ba9c-b7af0259895e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:50.367557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98b3c3-f348-4ce7-b6aa-1b9adc97f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:50.368852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98b3c3-f348-4ce7-b6aa-1b9adc97f7bf None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.369349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98b3c3-f348-4ce7-b6aa-1b9adc97f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.369804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98b3c3-f348-4ce7-b6aa-1b9adc97f7bf None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.370839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98b3c3-f348-4ce7-b6aa-1b9adc97f7bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:50.371404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98b3c3-f348-4ce7-b6aa-1b9adc97f7bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.373349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98b3c3-f348-4ce7-b6aa-1b9adc97f7bf None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.386017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2068ea-67df-42ff-96f6-ea0f58f4c324 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:50.395108 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 376/754] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:50.400867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98b3c3-f348-4ce7-b6aa-1b9adc97f7bf None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.426168 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279d66f-96db-472f-94ed-24ce3ad8b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:50.426859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279d66f-96db-472f-94ed-24ce3ad8b1af None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.427138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279d66f-96db-472f-94ed-24ce3ad8b1af None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.427414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279d66f-96db-472f-94ed-24ce3ad8b1af None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.428288 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279d66f-96db-472f-94ed-24ce3ad8b1af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:50.428596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279d66f-96db-472f-94ed-24ce3ad8b1af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.430080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279d66f-96db-472f-94ed-24ce3ad8b1af None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.448786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 379/755] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:50.455279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279d66f-96db-472f-94ed-24ce3ad8b1af None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.470042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:50.471400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:50.534732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98b3c3-f348-4ce7-b6aa-1b9adc97f7bf None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:50.560220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279d66f-96db-472f-94ed-24ce3ad8b1af None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:50.581946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa3cb4-c262-4bc7-807f-330d4b07b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:50.582532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3cb4-c262-4bc7-807f-330d4b07b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.582815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3cb4-c262-4bc7-807f-330d4b07b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.583093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3cb4-c262-4bc7-807f-330d4b07b1a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.598449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da35df-bf2e-4aee-bd07-b46fe52ca54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:50.599245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da35df-bf2e-4aee-bd07-b46fe52ca54f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.599620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da35df-bf2e-4aee-bd07-b46fe52ca54f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.599942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da35df-bf2e-4aee-bd07-b46fe52ca54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.611410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da35df-bf2e-4aee-bd07-b46fe52ca54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.613047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da35df-bf2e-4aee-bd07-b46fe52ca54f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-08da35df-bf2e-4aee-bd07-b46fe52ca54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:50.632986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:50.634011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:50.635290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:50.635290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:50.635290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:50.635290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:50.635290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 380/756] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:50.636631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276832ae-7e8d-43f0-8b92-99ba0b2d7b99 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.636631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276832ae-7e8d-43f0-8b92-99ba0b2d7b99 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.636631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276832ae-7e8d-43f0-8b92-99ba0b2d7b99 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.639334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 381/757] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:50.641365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276832ae-7e8d-43f0-8b92-99ba0b2d7b99 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.675541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa3cb4-c262-4bc7-807f-330d4b07b1a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.677756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa3cb4-c262-4bc7-807f-330d4b07b1a6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.718225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:50.725385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:50.759828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276832ae-7e8d-43f0-8b92-99ba0b2d7b99 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:50.802991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 377/758] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:50.804722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c69bf-0ec5-4d3a-ae68-91f7ecb9177e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.805491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c69bf-0ec5-4d3a-ae68-91f7ecb9177e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.805970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c69bf-0ec5-4d3a-ae68-91f7ecb9177e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.809324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799258ae-165d-4398-99b0-23c70cd5130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:50.813596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799258ae-165d-4398-99b0-23c70cd5130a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.813596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799258ae-165d-4398-99b0-23c70cd5130a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.813596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799258ae-165d-4398-99b0-23c70cd5130a None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.813596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799258ae-165d-4398-99b0-23c70cd5130a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:50.813596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799258ae-165d-4398-99b0-23c70cd5130a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.813596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799258ae-165d-4398-99b0-23c70cd5130a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.831180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9e1c69bf-0ec5-4d3a-ae68-91f7ecb9177e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:50.831390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 382/759] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:50.831390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799258ae-165d-4398-99b0-23c70cd5130a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.831529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9e1c69bf-0ec5-4d3a-ae68-91f7ecb9177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:50.901510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 378/760] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:20:50.903349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c69bf-0ec5-4d3a-ae68-91f7ecb9177e None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.940441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799258ae-165d-4398-99b0-23c70cd5130a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:50.964403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:50.973662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:50.976263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c81434-8ff7-4617-9cc5-6fcaaa469f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:50.977057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c81434-8ff7-4617-9cc5-6fcaaa469f59 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.985323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c81434-8ff7-4617-9cc5-6fcaaa469f59 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.985323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c81434-8ff7-4617-9cc5-6fcaaa469f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.988374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c81434-8ff7-4617-9cc5-6fcaaa469f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.989838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c81434-8ff7-4617-9cc5-6fcaaa469f59 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.006176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c69bf-0ec5-4d3a-ae68-91f7ecb9177e None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-78c81434-8ff7-4617-9cc5-6fcaaa469f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:51.012755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:51.013901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:51.015446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:51.015446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:51.015446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:51.015446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:51.019240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 383/761] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:51.020108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c81434-8ff7-4617-9cc5-6fcaaa469f59 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.063276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217332a-6156-491a-b6b7-1dba5a617de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.064100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217332a-6156-491a-b6b7-1dba5a617de1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.064381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217332a-6156-491a-b6b7-1dba5a617de1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.064657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217332a-6156-491a-b6b7-1dba5a617de1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.072071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217332a-6156-491a-b6b7-1dba5a617de1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.073529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217332a-6156-491a-b6b7-1dba5a617de1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-9217332a-6156-491a-b6b7-1dba5a617de1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:51.088802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:51.089696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:51.091137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:51.091137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:51.091137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:51.091137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:51.091137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:51.091137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:51.091137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:51.091137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:51.095399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 379/762] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:51.096187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217332a-6156-491a-b6b7-1dba5a617de1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.169559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c81434-8ff7-4617-9cc5-6fcaaa469f59 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.201666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217332a-6156-491a-b6b7-1dba5a617de1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.213075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e62fb-652f-4837-9550-c5af531739ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.213866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e62fb-652f-4837-9550-c5af531739ab None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.214144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e62fb-652f-4837-9550-c5af531739ab None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.214417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e62fb-652f-4837-9550-c5af531739ab None admin] PATH_INFO: `/v3/services/network` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.215602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e62fb-652f-4837-9550-c5af531739ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.217197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e62fb-652f-4837-9550-c5af531739ab None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-dd4e62fb-652f-4837-9550-c5af531739ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:51.229079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:51.230071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:20:51.231491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:51.234558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:51.236112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 384/763] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:51.236948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e62fb-652f-4837-9550-c5af531739ab None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.248236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ffc9e-0256-4199-8c5c-a241b9a30b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.249269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ffc9e-0256-4199-8c5c-a241b9a30b72 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.249720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ffc9e-0256-4199-8c5c-a241b9a30b72 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.250317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ffc9e-0256-4199-8c5c-a241b9a30b72 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.251141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ffc9e-0256-4199-8c5c-a241b9a30b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:51.251693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ffc9e-0256-4199-8c5c-a241b9a30b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.253335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ffc9e-0256-4199-8c5c-a241b9a30b72 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.271724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 380/764] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:51.273085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ffc9e-0256-4199-8c5c-a241b9a30b72 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.387371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ffc9e-0256-4199-8c5c-a241b9a30b72 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.399867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:51.430533 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516075e-4af4-4f7c-a8c7-eadadb7b8e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.431511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516075e-4af4-4f7c-a8c7-eadadb7b8e7a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.432029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516075e-4af4-4f7c-a8c7-eadadb7b8e7a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.432485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516075e-4af4-4f7c-a8c7-eadadb7b8e7a None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.433375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516075e-4af4-4f7c-a8c7-eadadb7b8e7a None admin] RBAC: Adding query filter params (name=network) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:51.434294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516075e-4af4-4f7c-a8c7-eadadb7b8e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.435882 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516075e-4af4-4f7c-a8c7-eadadb7b8e7a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.442577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 381/765] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:51.443625 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516075e-4af4-4f7c-a8c7-eadadb7b8e7a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.465802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e62fb-652f-4837-9550-c5af531739ab None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.501456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde04178-5bd8-47d5-97c6-bf8d627cca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.502137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde04178-5bd8-47d5-97c6-bf8d627cca04 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.502417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde04178-5bd8-47d5-97c6-bf8d627cca04 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.502733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde04178-5bd8-47d5-97c6-bf8d627cca04 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.503517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde04178-5bd8-47d5-97c6-bf8d627cca04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:51.503884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde04178-5bd8-47d5-97c6-bf8d627cca04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.505314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde04178-5bd8-47d5-97c6-bf8d627cca04 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.514483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:51.525572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 385/766] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:51.526409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde04178-5bd8-47d5-97c6-bf8d627cca04 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.562986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516075e-4af4-4f7c-a8c7-eadadb7b8e7a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.598962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acdf4b-ac87-43b1-bedb-9ce4776ef456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.600184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acdf4b-ac87-43b1-bedb-9ce4776ef456 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.600626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acdf4b-ac87-43b1-bedb-9ce4776ef456 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.601148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acdf4b-ac87-43b1-bedb-9ce4776ef456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.609518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acdf4b-ac87-43b1-bedb-9ce4776ef456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.611415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acdf4b-ac87-43b1-bedb-9ce4776ef456 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-c2acdf4b-ac87-43b1-bedb-9ce4776ef456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:51.627495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:51.628505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:51.629425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:51.629425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:51.629425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:51.629425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:51.629425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:51.629425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:51.629425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:51.629425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:51.635929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 382/767] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:51.637621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acdf4b-ac87-43b1-bedb-9ce4776ef456 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.656910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde04178-5bd8-47d5-97c6-bf8d627cca04 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.660029 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:51.695835 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfea36-505b-4d0c-902b-6b0d5ff82d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.696426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfea36-505b-4d0c-902b-6b0d5ff82d53 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.696715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfea36-505b-4d0c-902b-6b0d5ff82d53 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.696989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfea36-505b-4d0c-902b-6b0d5ff82d53 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.697686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfea36-505b-4d0c-902b-6b0d5ff82d53 None admin] RBAC: Adding query filter params (type=network) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:51.697989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfea36-505b-4d0c-902b-6b0d5ff82d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.699945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfea36-505b-4d0c-902b-6b0d5ff82d53 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.704723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 386/768] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:51.705693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfea36-505b-4d0c-902b-6b0d5ff82d53 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.748284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acdf4b-ac87-43b1-bedb-9ce4776ef456 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.758900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:51.784373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f399f-99be-409e-a9e5-281891270b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.786137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f399f-99be-409e-a9e5-281891270b88 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.786627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f399f-99be-409e-a9e5-281891270b88 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.787125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f399f-99be-409e-a9e5-281891270b88 None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/ba29f9c029fe4390af3b6ce1b2147ce9/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.791410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f399f-99be-409e-a9e5-281891270b88 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=ba29f9c029fe4390af3b6ce1b2147ce9, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.795343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f399f-99be-409e-a9e5-281891270b88 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.812137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfea36-505b-4d0c-902b-6b0d5ff82d53 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.844942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2851be-ef75-4b88-ac09-dba7750b2824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.845592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2851be-ef75-4b88-ac09-dba7750b2824 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.845871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2851be-ef75-4b88-ac09-dba7750b2824 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.846141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2851be-ef75-4b88-ac09-dba7750b2824 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.846911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2851be-ef75-4b88-ac09-dba7750b2824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:51.847215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2851be-ef75-4b88-ac09-dba7750b2824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.848665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2851be-ef75-4b88-ac09-dba7750b2824 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.859847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 387/769] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:51.861037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2a520-b006-4c0f-92d9-e7650ad43d5d None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.861324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2a520-b006-4c0f-92d9-e7650ad43d5d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.861599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2a520-b006-4c0f-92d9-e7650ad43d5d None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.866825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 388/770] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:51.867588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2a520-b006-4c0f-92d9-e7650ad43d5d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.893185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:51.895025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 383/771] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:20:51 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/ba29f9c029fe4390af3b6ce1b2147ce9/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:51.896130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f399f-99be-409e-a9e5-281891270b88 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:52.000546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2a520-b006-4c0f-92d9-e7650ad43d5d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:52.029112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f399f-99be-409e-a9e5-281891270b88 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:52.050836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ada542-ad15-4655-87b6-ef3e3be3dd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:52.051900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada542-ad15-4655-87b6-ef3e3be3dd4a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.052420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada542-ad15-4655-87b6-ef3e3be3dd4a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.052919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada542-ad15-4655-87b6-ef3e3be3dd4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.053928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ada542-ad15-4655-87b6-ef3e3be3dd4a None admin] RBAC: Adding query filter params (interface=public, service_id=0bc9c226694546018da93eb6da7ed85a, region_id=RegionOne) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:52.054507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ada542-ad15-4655-87b6-ef3e3be3dd4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:52.056186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ada542-ad15-4655-87b6-ef3e3be3dd4a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:52.069733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 389/772] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/endpoints?service_id=0bc9c226694546018da93eb6da7ed85a&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:52.071469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792bf97-a90e-4016-8b2f-d6016709cd96 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.072673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792bf97-a90e-4016-8b2f-d6016709cd96 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.072961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792bf97-a90e-4016-8b2f-d6016709cd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.076490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28911a7c-81a8-4dc1-ab31-7fc2dcade2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:52.077167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28911a7c-81a8-4dc1-ab31-7fc2dcade2f6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.077447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28911a7c-81a8-4dc1-ab31-7fc2dcade2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.077727 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28911a7c-81a8-4dc1-ab31-7fc2dcade2f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.078565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28911a7c-81a8-4dc1-ab31-7fc2dcade2f6 None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=32f11d0d46f94beba8913591371d5e33) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:52.078880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28911a7c-81a8-4dc1-ab31-7fc2dcade2f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:52.080369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28911a7c-81a8-4dc1-ab31-7fc2dcade2f6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:52.086607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 384/773] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/role_assignments?user.id=32f11d0d46f94beba8913591371d5e33&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:52.087211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28911a7c-81a8-4dc1-ab31-7fc2dcade2f6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:52.090027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7792bf97-a90e-4016-8b2f-d6016709cd96 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:52.091242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7792bf97-a90e-4016-8b2f-d6016709cd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:52.128509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:52.199871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 390/774] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:20:52.218071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28911a7c-81a8-4dc1-ab31-7fc2dcade2f6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:52.231682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792bf97-a90e-4016-8b2f-d6016709cd96 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:52.271332 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:52.272407 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0a39d-3b09-4e4f-b081-6c3853f9db62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:52.273096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0a39d-3b09-4e4f-b081-6c3853f9db62 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.273379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0a39d-3b09-4e4f-b081-6c3853f9db62 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.273656 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0a39d-3b09-4e4f-b081-6c3853f9db62 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.274346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0a39d-3b09-4e4f-b081-6c3853f9db62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:52.275756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0a39d-3b09-4e4f-b081-6c3853f9db62 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:52.290197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 385/775] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 16 00:20:52 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:52.372557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792bf97-a90e-4016-8b2f-d6016709cd96 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:52.408997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd38a91-7998-41f4-bb1f-0bbc6ee4fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:52.409834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38a91-7998-41f4-bb1f-0bbc6ee4fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.410116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38a91-7998-41f4-bb1f-0bbc6ee4fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.410407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38a91-7998-41f4-bb1f-0bbc6ee4fbc1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.411069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38a91-7998-41f4-bb1f-0bbc6ee4fbc1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:52.412523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38a91-7998-41f4-bb1f-0bbc6ee4fbc1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-ecd38a91-7998-41f4-bb1f-0bbc6ee4fbc1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:52.426163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:52.427157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:52.428266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 391/776] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Jun 16 00:20:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:52.433296 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0a39d-3b09-4e4f-b081-6c3853f9db62 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:52.563859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:52.575333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0a39d-3b09-4e4f-b081-6c3853f9db62 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:52.580451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e0b6-4d59-45b6-b4d4-c6897aedc93a None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.580747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e0b6-4d59-45b6-b4d4-c6897aedc93a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.581002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e0b6-4d59-45b6-b4d4-c6897aedc93a None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.582613 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 392/777] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:52.596479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d2df8-10e6-481e-b564-ce616f124854 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.596773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d2df8-10e6-481e-b564-ce616f124854 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.597051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d2df8-10e6-481e-b564-ce616f124854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.624259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdedec-fb9f-41dd-ac34-da10205cde24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:52.624680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-b75d2df8-10e6-481e-b564-ce616f124854 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:52.625368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdedec-fb9f-41dd-ac34-da10205cde24 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.625794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdedec-fb9f-41dd-ac34-da10205cde24 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.625907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b75d2df8-10e6-481e-b564-ce616f124854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:52.626304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdedec-fb9f-41dd-ac34-da10205cde24 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.627204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdedec-fb9f-41dd-ac34-da10205cde24 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:52.627707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdedec-fb9f-41dd-ac34-da10205cde24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:52.630258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdedec-fb9f-41dd-ac34-da10205cde24 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:52.636525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 386/778] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 16 00:20:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:52.643536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdedec-fb9f-41dd-ac34-da10205cde24 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:52.711051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 393/779] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:20:52.736536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d2df8-10e6-481e-b564-ce616f124854 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:52.761394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:52.775149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdedec-fb9f-41dd-ac34-da10205cde24 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:52.815486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9206bea-bb1e-49f4-9f4f-8644504280dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:52.816551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9206bea-bb1e-49f4-9f4f-8644504280dd None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.817140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9206bea-bb1e-49f4-9f4f-8644504280dd None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.817614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9206bea-bb1e-49f4-9f4f-8644504280dd None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.818522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9206bea-bb1e-49f4-9f4f-8644504280dd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:52.819028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9206bea-bb1e-49f4-9f4f-8644504280dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:52.820782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9206bea-bb1e-49f4-9f4f-8644504280dd None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:52.827189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 387/780] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 16 00:20:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:52.833484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9206bea-bb1e-49f4-9f4f-8644504280dd None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:52.860133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:52.938066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9206bea-bb1e-49f4-9f4f-8644504280dd None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:52.939841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d2df8-10e6-481e-b564-ce616f124854 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:52.975703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f4f58-371e-45c8-a550-0ea3fadab3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:52.976799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4f58-371e-45c8-a550-0ea3fadab3ab None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.977343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4f58-371e-45c8-a550-0ea3fadab3ab None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.977832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4f58-371e-45c8-a550-0ea3fadab3ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:52.978819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f4f58-371e-45c8-a550-0ea3fadab3ab None admin] RBAC: Adding query filter params (interface=public, service_id=b229d206d3794f7d908e4a7b09790227, region_id=RegionOne) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:52.979362 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f4f58-371e-45c8-a550-0ea3fadab3ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:52.981079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f4f58-371e-45c8-a550-0ea3fadab3ab None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:52.989516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 388/781] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 16 00:20:52 2022] GET /identity/v3/endpoints?service_id=b229d206d3794f7d908e4a7b09790227&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:52.995103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f4f58-371e-45c8-a550-0ea3fadab3ab None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:52.995415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7af2-103c-48b8-bc6f-42268c40acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:52.996398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7af2-103c-48b8-bc6f-42268c40acc0 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:52.996665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7af2-103c-48b8-bc6f-42268c40acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:52.996942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7af2-103c-48b8-bc6f-42268c40acc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:53.008088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d7af2-103c-48b8-bc6f-42268c40acc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-a55d7af2-103c-48b8-bc6f-42268c40acc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:53.016274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:53.017207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:53.018038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 394/782] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:53.029843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7af2-103c-48b8-bc6f-42268c40acc0 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:53.106401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:53.108854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f4f58-371e-45c8-a550-0ea3fadab3ab None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:53.112239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:53.141065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7af2-103c-48b8-bc6f-42268c40acc0 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:53.153664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2c380-8726-4418-9651-977633859ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:53.154634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2c380-8726-4418-9651-977633859ec6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:53.155120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2c380-8726-4418-9651-977633859ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:53.155615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2c380-8726-4418-9651-977633859ec6 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:53.156477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2c380-8726-4418-9651-977633859ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:53.158011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2c380-8726-4418-9651-977633859ec6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:53.171828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 389/783] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 16 00:20:52 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:53.177097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e485d-f77f-46ee-9ce7-7b568edb465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:53.177861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e485d-f77f-46ee-9ce7-7b568edb465c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:53.178277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e485d-f77f-46ee-9ce7-7b568edb465c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:53.178649 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e485d-f77f-46ee-9ce7-7b568edb465c None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:53.179480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e485d-f77f-46ee-9ce7-7b568edb465c None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:53.179890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e485d-f77f-46ee-9ce7-7b568edb465c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:53.181389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e485d-f77f-46ee-9ce7-7b568edb465c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:53.191272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 395/784] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:53.197076 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2c380-8726-4418-9651-977633859ec6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:53.361172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2c380-8726-4418-9651-977633859ec6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:53.413433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626fab3-b908-473b-8240-ab6dd3c6ec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:53.414249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626fab3-b908-473b-8240-ab6dd3c6ec36 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:53.414533 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626fab3-b908-473b-8240-ab6dd3c6ec36 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:53.414811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626fab3-b908-473b-8240-ab6dd3c6ec36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:53.430607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626fab3-b908-473b-8240-ab6dd3c6ec36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:53.432086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626fab3-b908-473b-8240-ab6dd3c6ec36 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-7626fab3-b908-473b-8240-ab6dd3c6ec36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:53.456495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:53.457425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:53.458298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:53.458298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:53.458298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:53.458298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:53.458298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 390/785] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:53.463756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e485d-f77f-46ee-9ce7-7b568edb465c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:53.593645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e485d-f77f-46ee-9ce7-7b568edb465c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:53.629657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39245c-7721-4464-b56b-760934e60b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:53.630255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39245c-7721-4464-b56b-760934e60b38 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:53.630542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39245c-7721-4464-b56b-760934e60b38 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:53.630823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39245c-7721-4464-b56b-760934e60b38 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:53.631931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39245c-7721-4464-b56b-760934e60b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:53.636306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39245c-7721-4464-b56b-760934e60b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:53.637696 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39245c-7721-4464-b56b-760934e60b38 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:53.639257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:53.652706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 396/786] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:53.660820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626fab3-b908-473b-8240-ab6dd3c6ec36 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:53.667255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:53.814458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626fab3-b908-473b-8240-ab6dd3c6ec36 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:53.857389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca78b6-f0c4-4ba9-9e58-a604a0629803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:53.858194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca78b6-f0c4-4ba9-9e58-a604a0629803 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:53.858478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca78b6-f0c4-4ba9-9e58-a604a0629803 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:53.858752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca78b6-f0c4-4ba9-9e58-a604a0629803 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:53.868515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca78b6-f0c4-4ba9-9e58-a604a0629803 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:53.869954 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca78b6-f0c4-4ba9-9e58-a604a0629803 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-a4ca78b6-f0c4-4ba9-9e58-a604a0629803 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:53.887532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:53.888591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:53.889513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 391/787] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:53.899259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39245c-7721-4464-b56b-760934e60b38 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:54.073632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39245c-7721-4464-b56b-760934e60b38 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:54.120261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adba1c-23d5-4722-9115-32abd504108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:54.121354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adba1c-23d5-4722-9115-32abd504108d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.121855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adba1c-23d5-4722-9115-32abd504108d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.122328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adba1c-23d5-4722-9115-32abd504108d None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.123370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adba1c-23d5-4722-9115-32abd504108d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:54.125473 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adba1c-23d5-4722-9115-32abd504108d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:54.127213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adba1c-23d5-4722-9115-32abd504108d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:54.146381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 397/788] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 16 00:20:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:54.152100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca78b6-f0c4-4ba9-9e58-a604a0629803 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:54.236149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:54.295432 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca78b6-f0c4-4ba9-9e58-a604a0629803 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:54.347355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9240f-f029-41d0-8515-6ea8831ce232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:54.348546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9240f-f029-41d0-8515-6ea8831ce232 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.349030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9240f-f029-41d0-8515-6ea8831ce232 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.349502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9240f-f029-41d0-8515-6ea8831ce232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.364561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9240f-f029-41d0-8515-6ea8831ce232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:54.366334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9240f-f029-41d0-8515-6ea8831ce232 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-88e9240f-f029-41d0-8515-6ea8831ce232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:54.389452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:54.390406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:54.391287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:54.391287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:54.391287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:54.391287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:54.397457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 392/789] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:54.400892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adba1c-23d5-4722-9115-32abd504108d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:54.500416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:54.541106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae1f2-16cc-497e-8cb6-91322beb2ea1 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.541420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae1f2-16cc-497e-8cb6-91322beb2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.541668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae1f2-16cc-497e-8cb6-91322beb2ea1 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.543335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 393/790] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:54.548413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5fb1-ef0e-4494-b747-c89f7ed6ae0a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.548705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5fb1-ef0e-4494-b747-c89f7ed6ae0a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.548981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5fb1-ef0e-4494-b747-c89f7ed6ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.575058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c39a5fb1-ef0e-4494-b747-c89f7ed6ae0a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:54.577748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adba1c-23d5-4722-9115-32abd504108d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:54.579588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c39a5fb1-ef0e-4494-b747-c89f7ed6ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:54.640860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b439bf3-89a6-42b5-b490-d30447447b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:54.641534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b439bf3-89a6-42b5-b490-d30447447b29 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.641813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b439bf3-89a6-42b5-b490-d30447447b29 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.642084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b439bf3-89a6-42b5-b490-d30447447b29 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.642810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b439bf3-89a6-42b5-b490-d30447447b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:54.643113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b439bf3-89a6-42b5-b490-d30447447b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:54.646293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b439bf3-89a6-42b5-b490-d30447447b29 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:54.668382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 398/791] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:54.672650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b439bf3-89a6-42b5-b490-d30447447b29 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:54.701422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 394/792] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:20:54.703215 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10c71b-5fff-4166-ad0d-70a237b804bb None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.703705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10c71b-5fff-4166-ad0d-70a237b804bb None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.704204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10c71b-5fff-4166-ad0d-70a237b804bb None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.709852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 395/793] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:54.711749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977604-9a51-4a07-8c4a-ff6b1f190c15 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.712246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977604-9a51-4a07-8c4a-ff6b1f190c15 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.712754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977604-9a51-4a07-8c4a-ff6b1f190c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.734037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-db977604-9a51-4a07-8c4a-ff6b1f190c15 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:54.736220 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-db977604-9a51-4a07-8c4a-ff6b1f190c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:54.795198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:54.799656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b439bf3-89a6-42b5-b490-d30447447b29 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:54.814021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:54.831696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 396/794] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:20:54.832978 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977604-9a51-4a07-8c4a-ff6b1f190c15 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:54.851587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b6800-f161-4409-9878-31b71825fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:54.852466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6800-f161-4409-9878-31b71825fa11 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.852747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6800-f161-4409-9878-31b71825fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.853021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6800-f161-4409-9878-31b71825fa11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.869302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b6800-f161-4409-9878-31b71825fa11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:54.870829 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b6800-f161-4409-9878-31b71825fa11 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-ec0b6800-f161-4409-9878-31b71825fa11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:54.891630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:54.892574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:54.893458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:54.893458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:54.893458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:54.893458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:54.893458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:54.893458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:54.893458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:54.893458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:54.893458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 399/795] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:54.898658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b6800-f161-4409-9878-31b71825fa11 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:54.956629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977604-9a51-4a07-8c4a-ff6b1f190c15 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:54.992726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51494183-d741-4580-93a5-073c9342ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:54.993575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494183-d741-4580-93a5-073c9342ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.993860 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494183-d741-4580-93a5-073c9342ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.994138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494183-d741-4580-93a5-073c9342ecd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.005079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51494183-d741-4580-93a5-073c9342ecd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:55.012747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b6800-f161-4409-9878-31b71825fa11 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-51494183-d741-4580-93a5-073c9342ecd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:55.013753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:55.014664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:55.015515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 397/796] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:20:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:55.016221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51494183-d741-4580-93a5-073c9342ecd3 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.053827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489056a-ad98-483b-9fa9-75e4b8bdd1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:55.055497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489056a-ad98-483b-9fa9-75e4b8bdd1ad None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.056114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489056a-ad98-483b-9fa9-75e4b8bdd1ad None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.056587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489056a-ad98-483b-9fa9-75e4b8bdd1ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.058458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:55.074414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489056a-ad98-483b-9fa9-75e4b8bdd1ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-4489056a-ad98-483b-9fa9-75e4b8bdd1ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:55.085335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:55.086252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:55.087078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:55.089539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 400/797] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:55.090359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489056a-ad98-483b-9fa9-75e4b8bdd1ad None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.131391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:55.141111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51494183-d741-4580-93a5-073c9342ecd3 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:55.189398 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3112e48-b040-4728-9bcf-fd77e16a40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:55.190167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3112e48-b040-4728-9bcf-fd77e16a40ae None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.190333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3112e48-b040-4728-9bcf-fd77e16a40ae None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.190606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3112e48-b040-4728-9bcf-fd77e16a40ae None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.191389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3112e48-b040-4728-9bcf-fd77e16a40ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:55.191698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3112e48-b040-4728-9bcf-fd77e16a40ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:55.193636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3112e48-b040-4728-9bcf-fd77e16a40ae None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:55.209903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 398/798] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:55.210675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3112e48-b040-4728-9bcf-fd77e16a40ae None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.223213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489056a-ad98-483b-9fa9-75e4b8bdd1ad None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:55.261170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b06b2-94d5-49a5-be16-87324c1c55f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:55.261860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b06b2-94d5-49a5-be16-87324c1c55f2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.262146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b06b2-94d5-49a5-be16-87324c1c55f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.262425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b06b2-94d5-49a5-be16-87324c1c55f2 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.263160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b06b2-94d5-49a5-be16-87324c1c55f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:55.263461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b06b2-94d5-49a5-be16-87324c1c55f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:55.264866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b06b2-94d5-49a5-be16-87324c1c55f2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:55.277266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 401/799] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:20:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:55.277266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b06b2-94d5-49a5-be16-87324c1c55f2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.314287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:55.320261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3112e48-b040-4728-9bcf-fd77e16a40ae None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:55.354238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fef75-f51a-4428-b4b0-86a43f0ac5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:55.354906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fef75-f51a-4428-b4b0-86a43f0ac5a0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.355190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fef75-f51a-4428-b4b0-86a43f0ac5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.356044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fef75-f51a-4428-b4b0-86a43f0ac5a0 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.356782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fef75-f51a-4428-b4b0-86a43f0ac5a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:55.357092 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fef75-f51a-4428-b4b0-86a43f0ac5a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:55.358488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fef75-f51a-4428-b4b0-86a43f0ac5a0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:55.367107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 399/800] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:55.368225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c544d5-3c55-415a-8b07-e40cfededbaa None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.368515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c544d5-3c55-415a-8b07-e40cfededbaa None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.368792 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c544d5-3c55-415a-8b07-e40cfededbaa None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.370130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 400/801] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:55.370705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c544d5-3c55-415a-8b07-e40cfededbaa None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.382313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:55.389711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b06b2-94d5-49a5-be16-87324c1c55f2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:55.426304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ffca8-1fb3-4958-bdd1-88b5aeea2d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:55.427614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ffca8-1fb3-4958-bdd1-88b5aeea2d5c None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.428081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ffca8-1fb3-4958-bdd1-88b5aeea2d5c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.428360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ffca8-1fb3-4958-bdd1-88b5aeea2d5c None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/e7ccca2836bc4004bcf39a3070b6c54f/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.430311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ffca8-1fb3-4958-bdd1-88b5aeea2d5c None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=e7ccca2836bc4004bcf39a3070b6c54f, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:55.431780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ffca8-1fb3-4958-bdd1-88b5aeea2d5c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:55.474974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c544d5-3c55-415a-8b07-e40cfededbaa None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:55.509666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33313e01-6ccd-4891-8455-693e0c17a2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:55.510477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313e01-6ccd-4891-8455-693e0c17a2c2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.510763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313e01-6ccd-4891-8455-693e0c17a2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.511039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313e01-6ccd-4891-8455-693e0c17a2c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.511879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 402/802] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:20:55 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/e7ccca2836bc4004bcf39a3070b6c54f/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:55.512767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ffca8-1fb3-4958-bdd1-88b5aeea2d5c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.523996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33313e01-6ccd-4891-8455-693e0c17a2c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:55.525534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33313e01-6ccd-4891-8455-693e0c17a2c2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-33313e01-6ccd-4891-8455-693e0c17a2c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:55.545057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:55.546035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:55.552124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:55.552124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:55.552124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:55.552124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:55.552124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 401/803] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:55.552124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b930f-4001-489c-aaa7-3ea683d083c4 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.552124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b930f-4001-489c-aaa7-3ea683d083c4 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.552124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b930f-4001-489c-aaa7-3ea683d083c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.574420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3b4b930f-4001-489c-aaa7-3ea683d083c4 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:55.576130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3b4b930f-4001-489c-aaa7-3ea683d083c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:55.579862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:55.660119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 402/804] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:20:55.661410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b930f-4001-489c-aaa7-3ea683d083c4 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.662114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ffca8-1fb3-4958-bdd1-88b5aeea2d5c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:55.701150 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d522f-7fe2-4da5-8f26-2bbabe403351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:55.701975 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d522f-7fe2-4da5-8f26-2bbabe403351 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.702229 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d522f-7fe2-4da5-8f26-2bbabe403351 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.702505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d522f-7fe2-4da5-8f26-2bbabe403351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.714433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d522f-7fe2-4da5-8f26-2bbabe403351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:55.716461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d522f-7fe2-4da5-8f26-2bbabe403351 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b81d522f-7fe2-4da5-8f26-2bbabe403351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:55.735539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:55.736694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:55.737580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:55.737580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:55.737580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:55.737580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:55.737580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 403/805] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:55.737580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d522f-7fe2-4da5-8f26-2bbabe403351 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.752983 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:55.804636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b930f-4001-489c-aaa7-3ea683d083c4 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:55.844781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d522f-7fe2-4da5-8f26-2bbabe403351 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:55.852587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d7b25-d97b-4417-b461-5ab6a9cdeeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:55.853536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d7b25-d97b-4417-b461-5ab6a9cdeeeb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.853972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d7b25-d97b-4417-b461-5ab6a9cdeeeb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.855332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d7b25-d97b-4417-b461-5ab6a9cdeeeb None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.856336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d7b25-d97b-4417-b461-5ab6a9cdeeeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:55.856802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d7b25-d97b-4417-b461-5ab6a9cdeeeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:55.859096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d7b25-d97b-4417-b461-5ab6a9cdeeeb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:55.877476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 403/806] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:55.878034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:55.879628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d7b25-d97b-4417-b461-5ab6a9cdeeeb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.894657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711f7cd-ec9f-40b9-94e6-8cf2fa8eaf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:55.895641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711f7cd-ec9f-40b9-94e6-8cf2fa8eaf99 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:55.896061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711f7cd-ec9f-40b9-94e6-8cf2fa8eaf99 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:55.896404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711f7cd-ec9f-40b9-94e6-8cf2fa8eaf99 None admin] PATH_INFO: `/v3/services/network` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:55.901766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711f7cd-ec9f-40b9-94e6-8cf2fa8eaf99 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:55.901766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711f7cd-ec9f-40b9-94e6-8cf2fa8eaf99 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-d711f7cd-ec9f-40b9-94e6-8cf2fa8eaf99 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:55.912306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:55.913291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:20:55.914105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:55.917154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 404/807] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:55 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:55.918207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711f7cd-ec9f-40b9-94e6-8cf2fa8eaf99 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:55.995354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:56.005302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d7b25-d97b-4417-b461-5ab6a9cdeeeb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.028164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711f7cd-ec9f-40b9-94e6-8cf2fa8eaf99 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.047671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b72fe3-281b-4cba-bc68-521f1070f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.048422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72fe3-281b-4cba-bc68-521f1070f78c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.048710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72fe3-281b-4cba-bc68-521f1070f78c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.049044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72fe3-281b-4cba-bc68-521f1070f78c None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.049767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b72fe3-281b-4cba-bc68-521f1070f78c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:56.050079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b72fe3-281b-4cba-bc68-521f1070f78c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.051450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b72fe3-281b-4cba-bc68-521f1070f78c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.068075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 404/808] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:56.068075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b72fe3-281b-4cba-bc68-521f1070f78c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.070854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2802596-7396-4ffe-9dc8-9ca211c95d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.071670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2802596-7396-4ffe-9dc8-9ca211c95d06 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.071986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2802596-7396-4ffe-9dc8-9ca211c95d06 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.072258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2802596-7396-4ffe-9dc8-9ca211c95d06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.080779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2802596-7396-4ffe-9dc8-9ca211c95d06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.082228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2802596-7396-4ffe-9dc8-9ca211c95d06 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b2802596-7396-4ffe-9dc8-9ca211c95d06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:56.097850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:56.098788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:56.099816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 405/809] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:20:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:56.101188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904199e-8f05-4578-9e43-e35220689b17 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.101188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904199e-8f05-4578-9e43-e35220689b17 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.101188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904199e-8f05-4578-9e43-e35220689b17 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.102481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 406/810] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:56.107131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904199e-8f05-4578-9e43-e35220689b17 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.139793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:56.184695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b72fe3-281b-4cba-bc68-521f1070f78c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.210723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904199e-8f05-4578-9e43-e35220689b17 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.222221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee66e40-da09-4d63-bde5-a37245b989c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.222979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee66e40-da09-4d63-bde5-a37245b989c0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.223336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee66e40-da09-4d63-bde5-a37245b989c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.223682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee66e40-da09-4d63-bde5-a37245b989c0 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.224482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee66e40-da09-4d63-bde5-a37245b989c0 None admin] RBAC: Adding query filter params (name=network) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:56.224860 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee66e40-da09-4d63-bde5-a37245b989c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.226286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee66e40-da09-4d63-bde5-a37245b989c0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.235188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 405/811] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:56.235188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee66e40-da09-4d63-bde5-a37245b989c0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.243054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:56.258161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983e711-d8a8-4565-b800-ca7ce61c267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.258161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983e711-d8a8-4565-b800-ca7ce61c267e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.258161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983e711-d8a8-4565-b800-ca7ce61c267e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.258161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983e711-d8a8-4565-b800-ca7ce61c267e None admin] PATH_INFO: `/v3/users/nova` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.262962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983e711-d8a8-4565-b800-ca7ce61c267e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.264636 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983e711-d8a8-4565-b800-ca7ce61c267e None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-f983e711-d8a8-4565-b800-ca7ce61c267e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:56.279249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:56.280430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:20:56.281577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:56.287985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 407/812] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:56.289682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbc0e8-c270-4790-a2c8-5a52394f9344 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.289975 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbc0e8-c270-4790-a2c8-5a52394f9344 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.290251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbc0e8-c270-4790-a2c8-5a52394f9344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.309420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-80cbc0e8-c270-4790-a2c8-5a52394f9344 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:56.310601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-80cbc0e8-c270-4790-a2c8-5a52394f9344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:56.347663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee66e40-da09-4d63-bde5-a37245b989c0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.373157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:56.384663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b4cd8-1c43-47d5-98e7-4253e418c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.385322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b4cd8-1c43-47d5-98e7-4253e418c59b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.385605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b4cd8-1c43-47d5-98e7-4253e418c59b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.385888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b4cd8-1c43-47d5-98e7-4253e418c59b None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.387290 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b4cd8-1c43-47d5-98e7-4253e418c59b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:56.387598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b4cd8-1c43-47d5-98e7-4253e418c59b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.389078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b4cd8-1c43-47d5-98e7-4253e418c59b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.392081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 408/813] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:20:56.392752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbc0e8-c270-4790-a2c8-5a52394f9344 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.407000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 406/814] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:56.407645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b4cd8-1c43-47d5-98e7-4253e418c59b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.504076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbc0e8-c270-4790-a2c8-5a52394f9344 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.515108 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b4cd8-1c43-47d5-98e7-4253e418c59b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.525949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:56.543903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba241f-7cea-409d-a1ee-a8032a66cfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.544503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba241f-7cea-409d-a1ee-a8032a66cfc5 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.544784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba241f-7cea-409d-a1ee-a8032a66cfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.545062 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba241f-7cea-409d-a1ee-a8032a66cfc5 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.545766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba241f-7cea-409d-a1ee-a8032a66cfc5 None admin] RBAC: Adding query filter params (type=network) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:56.546072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba241f-7cea-409d-a1ee-a8032a66cfc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.547440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba241f-7cea-409d-a1ee-a8032a66cfc5 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.550710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495d86f-2193-4384-b674-a280161e61ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.551318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495d86f-2193-4384-b674-a280161e61ac None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.551607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495d86f-2193-4384-b674-a280161e61ac None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.551919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495d86f-2193-4384-b674-a280161e61ac None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.552742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495d86f-2193-4384-b674-a280161e61ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:56.557254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495d86f-2193-4384-b674-a280161e61ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.557254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495d86f-2193-4384-b674-a280161e61ac None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.558125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 409/815] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:56.559425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba241f-7cea-409d-a1ee-a8032a66cfc5 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.574667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 407/816] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:56.575749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495d86f-2193-4384-b674-a280161e61ac None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.618244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:56.670399 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba241f-7cea-409d-a1ee-a8032a66cfc5 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.682495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495d86f-2193-4384-b674-a280161e61ac None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.708935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a96600-75da-42a0-ac85-f9bf541b82d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.709736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a96600-75da-42a0-ac85-f9bf541b82d6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.710025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a96600-75da-42a0-ac85-f9bf541b82d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.710298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a96600-75da-42a0-ac85-f9bf541b82d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.710953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a96600-75da-42a0-ac85-f9bf541b82d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.712362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a96600-75da-42a0-ac85-f9bf541b82d6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.718821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274881a3-cc77-441b-9977-d57159e92445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.719609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274881a3-cc77-441b-9977-d57159e92445 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.719933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274881a3-cc77-441b-9977-d57159e92445 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.720207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274881a3-cc77-441b-9977-d57159e92445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-20a96600-75da-42a0-ac85-f9bf541b82d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:56.725131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:56.726058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:56.732896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 410/817] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:56.733739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a96600-75da-42a0-ac85-f9bf541b82d6 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.735973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274881a3-cc77-441b-9977-d57159e92445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.737426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274881a3-cc77-441b-9977-d57159e92445 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-274881a3-cc77-441b-9977-d57159e92445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:56.757019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:56.757916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:56.758831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:56.758831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:56.758831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:56.758831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:56.758831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 408/818] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:56.759098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274881a3-cc77-441b-9977-d57159e92445 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.788321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:56.841933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a96600-75da-42a0-ac85-f9bf541b82d6 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.849710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:56.859377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274881a3-cc77-441b-9977-d57159e92445 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.877558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83733834-210d-4677-8781-e9cfd1536367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.878353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83733834-210d-4677-8781-e9cfd1536367 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.878732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83733834-210d-4677-8781-e9cfd1536367 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.879105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83733834-210d-4677-8781-e9cfd1536367 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.879967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83733834-210d-4677-8781-e9cfd1536367 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.881465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83733834-210d-4677-8781-e9cfd1536367 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.893849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82211a90-f535-41b8-82c4-645f368533ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.894497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82211a90-f535-41b8-82c4-645f368533ab None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.894785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82211a90-f535-41b8-82c4-645f368533ab None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.895064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82211a90-f535-41b8-82c4-645f368533ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.961143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82211a90-f535-41b8-82c4-645f368533ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.962573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82211a90-f535-41b8-82c4-645f368533ab None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.992839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 411/819] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 16 00:20:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:20:56.996417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83733834-210d-4677-8781-e9cfd1536367 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.092681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:57.111790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 409/820] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:57.111790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82211a90-f535-41b8-82c4-645f368533ab None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.125048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:57.130232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83733834-210d-4677-8781-e9cfd1536367 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:57.180551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aabef-e5d5-4bc2-8f59-827b9173958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:57.181232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aabef-e5d5-4bc2-8f59-827b9173958b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.181871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aabef-e5d5-4bc2-8f59-827b9173958b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.181871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aabef-e5d5-4bc2-8f59-827b9173958b None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.182539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69aabef-e5d5-4bc2-8f59-827b9173958b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:57.183831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69aabef-e5d5-4bc2-8f59-827b9173958b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:57.184626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69aabef-e5d5-4bc2-8f59-827b9173958b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:57.194376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 412/821] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:57.195248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aabef-e5d5-4bc2-8f59-827b9173958b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.241551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82211a90-f535-41b8-82c4-645f368533ab None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:57.278999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de3e13-eba5-4196-b370-5f1cb16e94ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:57.279664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de3e13-eba5-4196-b370-5f1cb16e94ba None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.279990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de3e13-eba5-4196-b370-5f1cb16e94ba None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.280272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de3e13-eba5-4196-b370-5f1cb16e94ba None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.281024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de3e13-eba5-4196-b370-5f1cb16e94ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:57.281331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de3e13-eba5-4196-b370-5f1cb16e94ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:57.282717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de3e13-eba5-4196-b370-5f1cb16e94ba None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:57.296206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 410/822] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:57.297290 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de3e13-eba5-4196-b370-5f1cb16e94ba None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.316730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aabef-e5d5-4bc2-8f59-827b9173958b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:57.353171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44d3ac-c680-46f1-b3b8-0ff1c813da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:57.353990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d3ac-c680-46f1-b3b8-0ff1c813da4b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.354273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d3ac-c680-46f1-b3b8-0ff1c813da4b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.354547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d3ac-c680-46f1-b3b8-0ff1c813da4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.366555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44d3ac-c680-46f1-b3b8-0ff1c813da4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:57.368083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44d3ac-c680-46f1-b3b8-0ff1c813da4b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-9c44d3ac-c680-46f1-b3b8-0ff1c813da4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:57.388121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:57.389080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:57.389947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:57.389947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:57.389947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:57.389947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:57.389947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 413/823] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:57.390785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44d3ac-c680-46f1-b3b8-0ff1c813da4b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.412591 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:57.480437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:57.501304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44d3ac-c680-46f1-b3b8-0ff1c813da4b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:57.531080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de3e13-eba5-4196-b370-5f1cb16e94ba None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:57.540181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511fcfa-b32e-441c-9c2a-1eefe71df8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:57.540986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511fcfa-b32e-441c-9c2a-1eefe71df8e9 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.541270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511fcfa-b32e-441c-9c2a-1eefe71df8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.541549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511fcfa-b32e-441c-9c2a-1eefe71df8e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.548443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511fcfa-b32e-441c-9c2a-1eefe71df8e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:57.549832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511fcfa-b32e-441c-9c2a-1eefe71df8e9 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-4511fcfa-b32e-441c-9c2a-1eefe71df8e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:57.564023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:57.564913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:57.565774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:57.565774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:57.565774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:57.565774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:57.565774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:57.565774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:57.565774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:57.565774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:57.565774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 414/824] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:57.566810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511fcfa-b32e-441c-9c2a-1eefe71df8e9 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.569742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5b129-7960-4bf5-8c04-e74e9146b487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:57.570416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b129-7960-4bf5-8c04-e74e9146b487 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.570696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b129-7960-4bf5-8c04-e74e9146b487 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.570970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b129-7960-4bf5-8c04-e74e9146b487 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.571669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5b129-7960-4bf5-8c04-e74e9146b487 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:57.572049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5b129-7960-4bf5-8c04-e74e9146b487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:57.573466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5b129-7960-4bf5-8c04-e74e9146b487 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:57.579396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 411/825] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 16 00:20:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:57.584057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5b129-7960-4bf5-8c04-e74e9146b487 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.651279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:57.676268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511fcfa-b32e-441c-9c2a-1eefe71df8e9 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:57.695173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5b129-7960-4bf5-8c04-e74e9146b487 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:57.712440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:57.713144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd3357-477a-4858-925d-4ea6537c0a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:57.713817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd3357-477a-4858-925d-4ea6537c0a9e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.714086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd3357-477a-4858-925d-4ea6537c0a9e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.714363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd3357-477a-4858-925d-4ea6537c0a9e None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.715107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd3357-477a-4858-925d-4ea6537c0a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:57.715409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd3357-477a-4858-925d-4ea6537c0a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:57.716821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd3357-477a-4858-925d-4ea6537c0a9e None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:57.728315 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 415/826] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:57.729116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd3357-477a-4858-925d-4ea6537c0a9e None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.730967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ff75b-7cd8-4456-a1b0-df702786d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:57.731628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ff75b-7cd8-4456-a1b0-df702786d206 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.731939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ff75b-7cd8-4456-a1b0-df702786d206 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.733248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ff75b-7cd8-4456-a1b0-df702786d206 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.733248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ff75b-7cd8-4456-a1b0-df702786d206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:57.733565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ff75b-7cd8-4456-a1b0-df702786d206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:57.734946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ff75b-7cd8-4456-a1b0-df702786d206 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:57.752340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 412/827] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:57.752340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a968a27-3784-4958-8c9f-5351c8b7294f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.752340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a968a27-3784-4958-8c9f-5351c8b7294f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.752340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a968a27-3784-4958-8c9f-5351c8b7294f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.752340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 413/828] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:20:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:57.752340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a968a27-3784-4958-8c9f-5351c8b7294f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.829770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd3357-477a-4858-925d-4ea6537c0a9e None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:57.850480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a968a27-3784-4958-8c9f-5351c8b7294f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:57.863706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4c507-9e18-4e3c-b2e0-6215673ba2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:57.864382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4c507-9e18-4e3c-b2e0-6215673ba2c6 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.864832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4c507-9e18-4e3c-b2e0-6215673ba2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.865106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4c507-9e18-4e3c-b2e0-6215673ba2c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.865825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4c507-9e18-4e3c-b2e0-6215673ba2c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:57.867188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4c507-9e18-4e3c-b2e0-6215673ba2c6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:57.871756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:57.883967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03342a9d-9755-4330-b5a5-edd0f10831f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:57.884737 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03342a9d-9755-4330-b5a5-edd0f10831f4 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.885016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03342a9d-9755-4330-b5a5-edd0f10831f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.885288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03342a9d-9755-4330-b5a5-edd0f10831f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.892349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03342a9d-9755-4330-b5a5-edd0f10831f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:57.893753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03342a9d-9755-4330-b5a5-edd0f10831f4 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-03342a9d-9755-4330-b5a5-edd0f10831f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:20:57.907073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:57.914071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 414/829] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:57.915155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03342a9d-9755-4330-b5a5-edd0f10831f4 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:57.929054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 416/830] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 16 00:20:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:20:57.930308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99ff1d-5558-4821-9422-8b1f62da0674 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:57.930601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99ff1d-5558-4821-9422-8b1f62da0674 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:57.930881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99ff1d-5558-4821-9422-8b1f62da0674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:57.950088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ea99ff1d-5558-4821-9422-8b1f62da0674 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:57.951306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ea99ff1d-5558-4821-9422-8b1f62da0674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:57.955124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:58.032528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 417/831] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:20:58.033397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99ff1d-5558-4821-9422-8b1f62da0674 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:58.045539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03342a9d-9755-4330-b5a5-edd0f10831f4 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:58.088725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9563f-423c-4668-8571-a7fd243fd97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:58.089566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9563f-423c-4668-8571-a7fd243fd97b None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.089848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9563f-423c-4668-8571-a7fd243fd97b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.090123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9563f-423c-4668-8571-a7fd243fd97b None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/32f11d0d46f94beba8913591371d5e33/roles/ef759eb79f6242fbbc2ec11a7807ad23` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.105046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9563f-423c-4668-8571-a7fd243fd97b None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=32f11d0d46f94beba8913591371d5e33, role_id=ef759eb79f6242fbbc2ec11a7807ad23)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:58.106996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9563f-423c-4668-8571-a7fd243fd97b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:58.148408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99ff1d-5558-4821-9422-8b1f62da0674 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:58.168230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:58.180764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 415/832] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:20:57 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/32f11d0d46f94beba8913591371d5e33/roles/ef759eb79f6242fbbc2ec11a7807ad23 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:20:58.187762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9563f-423c-4668-8571-a7fd243fd97b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:58.188009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e0e47-1b78-45cf-ab3a-1f466d536bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:58.188693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e0e47-1b78-45cf-ab3a-1f466d536bcd None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.188971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e0e47-1b78-45cf-ab3a-1f466d536bcd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.189247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e0e47-1b78-45cf-ab3a-1f466d536bcd None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.190049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e0e47-1b78-45cf-ab3a-1f466d536bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:58.190358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e0e47-1b78-45cf-ab3a-1f466d536bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:58.191892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e0e47-1b78-45cf-ab3a-1f466d536bcd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:58.211316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 418/833] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:20:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:58.213072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e0e47-1b78-45cf-ab3a-1f466d536bcd None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:58.314797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:58.327161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e0e47-1b78-45cf-ab3a-1f466d536bcd None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:58.332962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9563f-423c-4668-8571-a7fd243fd97b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:58.371505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc8c95-9e20-4616-a1d0-c0c71d97a72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:58.371505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc8c95-9e20-4616-a1d0-c0c71d97a72d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.371505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc8c95-9e20-4616-a1d0-c0c71d97a72d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.371505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc8c95-9e20-4616-a1d0-c0c71d97a72d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.371979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc8c95-9e20-4616-a1d0-c0c71d97a72d None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=ba29f9c029fe4390af3b6ce1b2147ce9) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:58.371979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc8c95-9e20-4616-a1d0-c0c71d97a72d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:58.371979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc8c95-9e20-4616-a1d0-c0c71d97a72d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:58.373535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d66ad8-2028-4430-8095-ab300d619f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:58.374505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66ad8-2028-4430-8095-ab300d619f8f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.374794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66ad8-2028-4430-8095-ab300d619f8f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.375049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66ad8-2028-4430-8095-ab300d619f8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.376955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 419/834] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:20:58 2022] GET /identity/v3/role_assignments?user.id=ba29f9c029fe4390af3b6ce1b2147ce9&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=635caa85d8524fb887206fd521defd3f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:58.390483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d66ad8-2028-4430-8095-ab300d619f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-f8d66ad8-2028-4430-8095-ab300d619f8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:20:58.398996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:58.400268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:20:58.401174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:58.407769 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 416/835] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:58.411001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc8c95-9e20-4616-a1d0-c0c71d97a72d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:58.461243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:58.526713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc8c95-9e20-4616-a1d0-c0c71d97a72d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:58.564805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff932ef-46d1-42e2-a4fa-24f5ce2a889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:58.565488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff932ef-46d1-42e2-a4fa-24f5ce2a889d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.565771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff932ef-46d1-42e2-a4fa-24f5ce2a889d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.566049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff932ef-46d1-42e2-a4fa-24f5ce2a889d None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.566872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff932ef-46d1-42e2-a4fa-24f5ce2a889d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:58.567181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff932ef-46d1-42e2-a4fa-24f5ce2a889d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:58.568661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff932ef-46d1-42e2-a4fa-24f5ce2a889d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:58.578017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 420/836] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:58.583449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d66ad8-2028-4430-8095-ab300d619f8f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:58.694277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d66ad8-2028-4430-8095-ab300d619f8f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:58.729527 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783b54b-377d-45d4-8675-5597b179bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:58.730873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783b54b-377d-45d4-8675-5597b179bf83 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.731152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783b54b-377d-45d4-8675-5597b179bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.731491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783b54b-377d-45d4-8675-5597b179bf83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.742973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783b54b-377d-45d4-8675-5597b179bf83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:58.744484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783b54b-377d-45d4-8675-5597b179bf83 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-6783b54b-377d-45d4-8675-5597b179bf83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:58.762951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:58.763914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:58.764799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:58.764799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:58.764799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:58.764799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:58.764799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:58.764799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 417/837] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:20:58.771079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff932ef-46d1-42e2-a4fa-24f5ce2a889d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:58.880597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff932ef-46d1-42e2-a4fa-24f5ce2a889d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:58.883182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:58.919365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472740f0-ef1a-4c14-8a70-b310489fb907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:58.920463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472740f0-ef1a-4c14-8a70-b310489fb907 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.920945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472740f0-ef1a-4c14-8a70-b310489fb907 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.921415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472740f0-ef1a-4c14-8a70-b310489fb907 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.922328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472740f0-ef1a-4c14-8a70-b310489fb907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:58.922830 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472740f0-ef1a-4c14-8a70-b310489fb907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:58.924427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472740f0-ef1a-4c14-8a70-b310489fb907 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:58.939049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 421/838] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:58.944780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783b54b-377d-45d4-8675-5597b179bf83 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:59.053592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783b54b-377d-45d4-8675-5597b179bf83 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:59.091172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932b1f0-a2c2-48c4-8504-41eae3ff3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:59.092065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932b1f0-a2c2-48c4-8504-41eae3ff3426 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:59.092349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932b1f0-a2c2-48c4-8504-41eae3ff3426 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:59.092621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932b1f0-a2c2-48c4-8504-41eae3ff3426 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:59.100662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932b1f0-a2c2-48c4-8504-41eae3ff3426 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:59.102089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932b1f0-a2c2-48c4-8504-41eae3ff3426 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-7932b1f0-a2c2-48c4-8504-41eae3ff3426 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:20:59.116274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:59.117208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:20:59.118143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 418/839] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:20:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:59.124913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472740f0-ef1a-4c14-8a70-b310489fb907 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:59.233381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472740f0-ef1a-4c14-8a70-b310489fb907 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:59.268392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b5fa-3f45-425e-acc9-fcb55659f034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:59.269063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b5fa-3f45-425e-acc9-fcb55659f034 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:59.269344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b5fa-3f45-425e-acc9-fcb55659f034 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:59.269619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b5fa-3f45-425e-acc9-fcb55659f034 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:59.270444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70b5fa-3f45-425e-acc9-fcb55659f034 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:59.270753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70b5fa-3f45-425e-acc9-fcb55659f034 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:59.272235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70b5fa-3f45-425e-acc9-fcb55659f034 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:59.290194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 422/840] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 16 00:20:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:20:59.295718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932b1f0-a2c2-48c4-8504-41eae3ff3426 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:59.358509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:59.400097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932b1f0-a2c2-48c4-8504-41eae3ff3426 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:59.435759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460b727-3316-4324-9234-a6e0ca1325a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:59.436426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460b727-3316-4324-9234-a6e0ca1325a3 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:59.436879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460b727-3316-4324-9234-a6e0ca1325a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:59.437213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460b727-3316-4324-9234-a6e0ca1325a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:59.505787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460b727-3316-4324-9234-a6e0ca1325a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:59.507405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460b727-3316-4324-9234-a6e0ca1325a3 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:59.568133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:59.610455 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 419/841] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:20:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:59.616326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b5fa-3f45-425e-acc9-fcb55659f034 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:59.642765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:59.720023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b5fa-3f45-425e-acc9-fcb55659f034 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:59.755160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacc16-7aca-4158-9ece-b0885a813695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:59.756095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacc16-7aca-4158-9ece-b0885a813695 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:59.756322 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacc16-7aca-4158-9ece-b0885a813695 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:59.756853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacc16-7aca-4158-9ece-b0885a813695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:59.767226 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccacc16-7aca-4158-9ece-b0885a813695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:59.768702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccacc16-7aca-4158-9ece-b0885a813695 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-4ccacc16-7aca-4158-9ece-b0885a813695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:20:59.785952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:20:59.786812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:20:59.787675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:20:59.787675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:20:59.787675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:20:59.787675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:20:59.787675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 423/842] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:20:59.794643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460b727-3316-4324-9234-a6e0ca1325a3 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:59.898489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460b727-3316-4324-9234-a6e0ca1325a3 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:59.932572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2844098-2655-404c-b89a-89bf74986ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:59.933758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844098-2655-404c-b89a-89bf74986ef4 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:59.934107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844098-2655-404c-b89a-89bf74986ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:59.934378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844098-2655-404c-b89a-89bf74986ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:59.935085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2844098-2655-404c-b89a-89bf74986ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:20:59.935390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2844098-2655-404c-b89a-89bf74986ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:59.936778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2844098-2655-404c-b89a-89bf74986ef4 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:59.948442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 420/843] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:20:59.954548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacc16-7aca-4158-9ece-b0885a813695 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.035640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.069935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacc16-7aca-4158-9ece-b0885a813695 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.106555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a0228-0866-4ea9-a485-691f214e29b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.107355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a0228-0866-4ea9-a485-691f214e29b1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.107637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a0228-0866-4ea9-a485-691f214e29b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.107940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a0228-0866-4ea9-a485-691f214e29b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.115000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a0228-0866-4ea9-a485-691f214e29b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.115286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1ab10-7f34-42f6-9adf-53c0a8d124e0 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.115586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1ab10-7f34-42f6-9adf-53c0a8d124e0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.115902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1ab10-7f34-42f6-9adf-53c0a8d124e0 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.116488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a0228-0866-4ea9-a485-691f214e29b1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.117502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 421/844] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:00.123103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f1059-1f0f-4dfb-94f3-204eee0bc606 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.123393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f1059-1f0f-4dfb-94f3-204eee0bc606 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.123679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f1059-1f0f-4dfb-94f3-204eee0bc606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b24a0228-0866-4ea9-a485-691f214e29b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:21:00.131300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:00.132487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:00.133356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:21:00.133356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:21:00.133356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:21:00.133356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:21:00.133356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:21:00.133356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:21:00.133356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:00.133356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:00.133356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 424/845] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:00.140762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a0228-0866-4ea9-a485-691f214e29b1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.141364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f84f1059-1f0f-4dfb-94f3-204eee0bc606 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:00.142529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f84f1059-1f0f-4dfb-94f3-204eee0bc606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:00.157989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.216395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 422/846] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:00.238079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f1059-1f0f-4dfb-94f3-204eee0bc606 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.266735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a0228-0866-4ea9-a485-691f214e29b1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.312031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a85928-5209-4b2b-a375-634884693f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.312747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a85928-5209-4b2b-a375-634884693f18 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.313101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a85928-5209-4b2b-a375-634884693f18 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.313445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a85928-5209-4b2b-a375-634884693f18 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.314819 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a85928-5209-4b2b-a375-634884693f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:00.315199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a85928-5209-4b2b-a375-634884693f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.317231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a85928-5209-4b2b-a375-634884693f18 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.319629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.334565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 425/847] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:00.340341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a85928-5209-4b2b-a375-634884693f18 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.347087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f1059-1f0f-4dfb-94f3-204eee0bc606 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.389056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ed408-383c-467f-abe2-92ac4135639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.390907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed408-383c-467f-abe2-92ac4135639f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.391674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed408-383c-467f-abe2-92ac4135639f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.392152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed408-383c-467f-abe2-92ac4135639f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.393230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ed408-383c-467f-abe2-92ac4135639f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.394997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ed408-383c-467f-abe2-92ac4135639f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-468ed408-383c-467f-abe2-92ac4135639f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:00.413008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:00.414254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:21:00.415266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:00.418522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 423/848] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:00.424789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ed408-383c-467f-abe2-92ac4135639f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.441921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.462645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a85928-5209-4b2b-a375-634884693f18 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.516946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a2adf-a266-460f-b503-1e349b2651ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.518210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a2adf-a266-460f-b503-1e349b2651ed None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.518645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a2adf-a266-460f-b503-1e349b2651ed None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.519069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a2adf-a266-460f-b503-1e349b2651ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.520395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a2adf-a266-460f-b503-1e349b2651ed None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=e7ccca2836bc4004bcf39a3070b6c54f) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:00.521431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a2adf-a266-460f-b503-1e349b2651ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.523407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a2adf-a266-460f-b503-1e349b2651ed None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.532913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 426/849] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/role_assignments?user.id=e7ccca2836bc4004bcf39a3070b6c54f&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=635caa85d8524fb887206fd521defd3f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:00.542243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ed408-383c-467f-abe2-92ac4135639f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.567512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf49eeb-86b8-4e94-b828-17ae70a442d5 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.567512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf49eeb-86b8-4e94-b828-17ae70a442d5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.567831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf49eeb-86b8-4e94-b828-17ae70a442d5 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.569299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 427/850] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:00.574830 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a21d-a292-4e2d-bdfc-6dfcde6b5c03 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.575114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a21d-a292-4e2d-bdfc-6dfcde6b5c03 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.575397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a21d-a292-4e2d-bdfc-6dfcde6b5c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.585191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7c11-9b50-41d3-8233-d892f4a6a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.586129 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7c11-9b50-41d3-8233-d892f4a6a048 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.587141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7c11-9b50-41d3-8233-d892f4a6a048 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.587572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7c11-9b50-41d3-8233-d892f4a6a048 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.588641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f7c11-9b50-41d3-8233-d892f4a6a048 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:00.589313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f7c11-9b50-41d3-8233-d892f4a6a048 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.590925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f7c11-9b50-41d3-8233-d892f4a6a048 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.592971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-1018a21d-a292-4e2d-bdfc-6dfcde6b5c03 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:00.594214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1018a21d-a292-4e2d-bdfc-6dfcde6b5c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:00.598721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 424/851] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:00.607781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7c11-9b50-41d3-8233-d892f4a6a048 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.658084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.676823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 428/852] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:00.699914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a21d-a292-4e2d-bdfc-6dfcde6b5c03 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.708581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.735122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7c11-9b50-41d3-8233-d892f4a6a048 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.778839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bdd1f-9263-4314-a10f-ed7906fa7e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.779777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bdd1f-9263-4314-a10f-ed7906fa7e33 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.780071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bdd1f-9263-4314-a10f-ed7906fa7e33 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.780356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bdd1f-9263-4314-a10f-ed7906fa7e33 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.781061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bdd1f-9263-4314-a10f-ed7906fa7e33 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:00.781378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bdd1f-9263-4314-a10f-ed7906fa7e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.782760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bdd1f-9263-4314-a10f-ed7906fa7e33 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.787544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 425/853] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:00.788961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1816d-42e8-4937-afa2-c83a23f50db1 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.789251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1816d-42e8-4937-afa2-c83a23f50db1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.789526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1816d-42e8-4937-afa2-c83a23f50db1 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.790910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 426/854] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:00.797200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840074c4-ed03-4ff4-a140-d3b397707fe1 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.797517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840074c4-ed03-4ff4-a140-d3b397707fe1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.797766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840074c4-ed03-4ff4-a140-d3b397707fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.816255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-840074c4-ed03-4ff4-a140-d3b397707fe1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:00.818042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-840074c4-ed03-4ff4-a140-d3b397707fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:00.821558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a21d-a292-4e2d-bdfc-6dfcde6b5c03 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.859912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5d851-163f-463e-9518-74c5c02522eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.861091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5d851-163f-463e-9518-74c5c02522eb None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.861620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5d851-163f-463e-9518-74c5c02522eb None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.862100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5d851-163f-463e-9518-74c5c02522eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.876689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5d851-163f-463e-9518-74c5c02522eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-01f5d851-163f-463e-9518-74c5c02522eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:00.887546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:00.888585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:00.889418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 429/855] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:00.894611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5d851-163f-463e-9518-74c5c02522eb None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.907830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 427/856] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:00.933606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840074c4-ed03-4ff4-a140-d3b397707fe1 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.962367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:01.027828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:01.046208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5d851-163f-463e-9518-74c5c02522eb None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.069955 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840074c4-ed03-4ff4-a140-d3b397707fe1 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.085027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dc120-99ca-450d-aa85-d7a07b07c00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.085833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc120-99ca-450d-aa85-d7a07b07c00d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.086225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc120-99ca-450d-aa85-d7a07b07c00d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.086661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc120-99ca-450d-aa85-d7a07b07c00d None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.087430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434dc120-99ca-450d-aa85-d7a07b07c00d None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:01.087866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434dc120-99ca-450d-aa85-d7a07b07c00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.089389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434dc120-99ca-450d-aa85-d7a07b07c00d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.102656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 430/857] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:01.103961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dc120-99ca-450d-aa85-d7a07b07c00d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.114694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d691-9cd7-471a-a283-a42220311788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.116202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d691-9cd7-471a-a283-a42220311788 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.116942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d691-9cd7-471a-a283-a42220311788 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.117394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d691-9cd7-471a-a283-a42220311788 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.118522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d691-9cd7-471a-a283-a42220311788 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.120682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d691-9cd7-471a-a283-a42220311788 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-8cc9d691-9cd7-471a-a283-a42220311788 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:01.138909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:01.140051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:21:01.140867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:01.144281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 428/858] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:01.150056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d691-9cd7-471a-a283-a42220311788 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.231093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dc120-99ca-450d-aa85-d7a07b07c00d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.244078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:01.266399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d691-9cd7-471a-a283-a42220311788 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.268692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf022-973b-4ea2-93d9-a4d2dda21032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.269605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf022-973b-4ea2-93d9-a4d2dda21032 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.270683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf022-973b-4ea2-93d9-a4d2dda21032 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.270683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf022-973b-4ea2-93d9-a4d2dda21032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.281716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdf022-973b-4ea2-93d9-a4d2dda21032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.283365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdf022-973b-4ea2-93d9-a4d2dda21032 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-33cdf022-973b-4ea2-93d9-a4d2dda21032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:01.300864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:01.301957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:01.303040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:01.303040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:01.303040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:01.303040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:01.305421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 431/859] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:01.311464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf022-973b-4ea2-93d9-a4d2dda21032 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.313926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e1c1e-0c0f-42df-9905-71cf9ed32048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.314813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e1c1e-0c0f-42df-9905-71cf9ed32048 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.315279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e1c1e-0c0f-42df-9905-71cf9ed32048 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.315829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e1c1e-0c0f-42df-9905-71cf9ed32048 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.316756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e1c1e-0c0f-42df-9905-71cf9ed32048 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:01.317271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e1c1e-0c0f-42df-9905-71cf9ed32048 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.318840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e1c1e-0c0f-42df-9905-71cf9ed32048 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.320327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:01.325922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 429/860] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:01.336923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e1c1e-0c0f-42df-9905-71cf9ed32048 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.426824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf022-973b-4ea2-93d9-a4d2dda21032 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.465515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74fbb-732f-4b45-9e7f-709121f03a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.466186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74fbb-732f-4b45-9e7f-709121f03a7d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.466387 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e1c1e-0c0f-42df-9905-71cf9ed32048 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.466809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74fbb-732f-4b45-9e7f-709121f03a7d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.466809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74fbb-732f-4b45-9e7f-709121f03a7d None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.467451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74fbb-732f-4b45-9e7f-709121f03a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:01.467895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74fbb-732f-4b45-9e7f-709121f03a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.469378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74fbb-732f-4b45-9e7f-709121f03a7d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.487039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 432/861] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:01.488109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74fbb-732f-4b45-9e7f-709121f03a7d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.506775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02111afe-0274-4aec-8fd8-817e0ddba850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.507706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02111afe-0274-4aec-8fd8-817e0ddba850 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.508015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02111afe-0274-4aec-8fd8-817e0ddba850 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.508291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02111afe-0274-4aec-8fd8-817e0ddba850 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.509232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02111afe-0274-4aec-8fd8-817e0ddba850 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:01.509544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02111afe-0274-4aec-8fd8-817e0ddba850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.511904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02111afe-0274-4aec-8fd8-817e0ddba850 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.516761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:01.519818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 430/862] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:01.612548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74fbb-732f-4b45-9e7f-709121f03a7d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.651299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503029-9b47-4e11-abff-d9351850c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.652272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503029-9b47-4e11-abff-d9351850c75a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.652561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503029-9b47-4e11-abff-d9351850c75a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.652838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503029-9b47-4e11-abff-d9351850c75a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.661119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8503029-9b47-4e11-abff-d9351850c75a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.662676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8503029-9b47-4e11-abff-d9351850c75a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-f8503029-9b47-4e11-abff-d9351850c75a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:21:01.680037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:01.682320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:01.685170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 433/863] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:21:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:01.691925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02111afe-0274-4aec-8fd8-817e0ddba850 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.759154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:01.799139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02111afe-0274-4aec-8fd8-817e0ddba850 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.835541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89e624-929d-48cf-a848-2ef15d6a7eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.836503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89e624-929d-48cf-a848-2ef15d6a7eaf None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.836956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89e624-929d-48cf-a848-2ef15d6a7eaf None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.837382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89e624-929d-48cf-a848-2ef15d6a7eaf None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.838422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89e624-929d-48cf-a848-2ef15d6a7eaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:01.838881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89e624-929d-48cf-a848-2ef15d6a7eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.840518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89e624-929d-48cf-a848-2ef15d6a7eaf None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.859756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 431/864] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 16 00:21:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:01.865695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503029-9b47-4e11-abff-d9351850c75a None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.952205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:01.971095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503029-9b47-4e11-abff-d9351850c75a None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:02.007949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9f7d9-fded-4e25-9f2e-f5e19a525e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:02.008872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9f7d9-fded-4e25-9f2e-f5e19a525e2f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:02.009306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9f7d9-fded-4e25-9f2e-f5e19a525e2f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:02.009731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9f7d9-fded-4e25-9f2e-f5e19a525e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:02.079992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9f7d9-fded-4e25-9f2e-f5e19a525e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:02.081720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9f7d9-fded-4e25-9f2e-f5e19a525e2f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:02.164688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:02.184268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 434/865] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:02.190007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89e624-929d-48cf-a848-2ef15d6a7eaf None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:02.291929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89e624-929d-48cf-a848-2ef15d6a7eaf None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:02.312886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:02.327678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb600e6f-0680-4a42-9b4d-9b455252a787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:02.328605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb600e6f-0680-4a42-9b4d-9b455252a787 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:02.328892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb600e6f-0680-4a42-9b4d-9b455252a787 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:02.329173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb600e6f-0680-4a42-9b4d-9b455252a787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:02.341128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb600e6f-0680-4a42-9b4d-9b455252a787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:02.342584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb600e6f-0680-4a42-9b4d-9b455252a787 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-bb600e6f-0680-4a42-9b4d-9b455252a787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:02.360738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:02.361624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:02.363410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:02.363410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:02.363410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:02.363410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:02.363410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 432/866] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:02.367873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9f7d9-fded-4e25-9f2e-f5e19a525e2f None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:02.472644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9f7d9-fded-4e25-9f2e-f5e19a525e2f None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:02.507481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd60d9-c1d8-4d57-b8e3-c126d54a117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:02.508183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd60d9-c1d8-4d57-b8e3-c126d54a117c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:02.508465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd60d9-c1d8-4d57-b8e3-c126d54a117c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:02.508739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd60d9-c1d8-4d57-b8e3-c126d54a117c None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:02.509451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd60d9-c1d8-4d57-b8e3-c126d54a117c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:02.509757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd60d9-c1d8-4d57-b8e3-c126d54a117c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:02.511151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd60d9-c1d8-4d57-b8e3-c126d54a117c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:02.523702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 435/867] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:02.529636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb600e6f-0680-4a42-9b4d-9b455252a787 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:02.639022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb600e6f-0680-4a42-9b4d-9b455252a787 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:02.674544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d7524-371e-4622-951a-e9c19eacbb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:02.675370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7524-371e-4622-951a-e9c19eacbb9e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:02.675646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7524-371e-4622-951a-e9c19eacbb9e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:02.675949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7524-371e-4622-951a-e9c19eacbb9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:02.684176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d7524-371e-4622-951a-e9c19eacbb9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:02.685648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d7524-371e-4622-951a-e9c19eacbb9e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-7b7d7524-371e-4622-951a-e9c19eacbb9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:21:02.701243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:02.702227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:02.703107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:21:02.703107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:21:02.703107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:21:02.703107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:21:02.703107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:21:02.703107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:21:02.703107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:02.703107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:02.703107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 433/868] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:02.712859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd60d9-c1d8-4d57-b8e3-c126d54a117c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:02.739160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8dc1c-79d5-4e60-80e3-c89f1f497c57 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:02.739456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8dc1c-79d5-4e60-80e3-c89f1f497c57 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:02.739654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8dc1c-79d5-4e60-80e3-c89f1f497c57 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:02.741332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 434/869] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:02.746265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383019f7-5f26-4bb4-b395-85a59b29d9ec None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:02.746589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383019f7-5f26-4bb4-b395-85a59b29d9ec None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:02.746842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383019f7-5f26-4bb4-b395-85a59b29d9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:02.763043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:02.767711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-383019f7-5f26-4bb4-b395-85a59b29d9ec None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:02.769136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-383019f7-5f26-4bb4-b395-85a59b29d9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:02.798669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:02.824286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd60d9-c1d8-4d57-b8e3-c126d54a117c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:02.849255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 435/870] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:02.866538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc35114-da13-4ac8-9e10-d581619f583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:02.867255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc35114-da13-4ac8-9e10-d581619f583f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:02.867575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc35114-da13-4ac8-9e10-d581619f583f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:02.867884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc35114-da13-4ac8-9e10-d581619f583f None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:02.868664 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc35114-da13-4ac8-9e10-d581619f583f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:02.868969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc35114-da13-4ac8-9e10-d581619f583f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:02.870519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc35114-da13-4ac8-9e10-d581619f583f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:02.871380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383019f7-5f26-4bb4-b395-85a59b29d9ec None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:02.889101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 436/871] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:02.890267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc35114-da13-4ac8-9e10-d581619f583f None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:02.985003 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383019f7-5f26-4bb4-b395-85a59b29d9ec None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:03.005440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc35114-da13-4ac8-9e10-d581619f583f None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:03.007241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:03.022098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44364ed-17f9-48aa-8288-fe09c4a9159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:03.025854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44364ed-17f9-48aa-8288-fe09c4a9159e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:03.025854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44364ed-17f9-48aa-8288-fe09c4a9159e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:03.025854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44364ed-17f9-48aa-8288-fe09c4a9159e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:03.025854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44364ed-17f9-48aa-8288-fe09c4a9159e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:03.025854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44364ed-17f9-48aa-8288-fe09c4a9159e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-c44364ed-17f9-48aa-8288-fe09c4a9159e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:03.038911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:03.040020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:03.040851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 436/872] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:03.042156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f5976-8f7f-4e8b-89ad-b3ed646269df None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:03.042156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f5976-8f7f-4e8b-89ad-b3ed646269df None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:03.042429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f5976-8f7f-4e8b-89ad-b3ed646269df None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:03.047512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 437/873] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:03.047512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f5976-8f7f-4e8b-89ad-b3ed646269df None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:03.055908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a22a3d-88a6-4a5d-94a9-fe2df8307056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:03.056683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a22a3d-88a6-4a5d-94a9-fe2df8307056 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:03.056968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a22a3d-88a6-4a5d-94a9-fe2df8307056 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:03.057244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a22a3d-88a6-4a5d-94a9-fe2df8307056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:03.058702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a22a3d-88a6-4a5d-94a9-fe2df8307056 None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=32f11d0d46f94beba8913591371d5e33) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:03.059016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a22a3d-88a6-4a5d-94a9-fe2df8307056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:03.060470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a22a3d-88a6-4a5d-94a9-fe2df8307056 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:03.070008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 437/874] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:02 2022] GET /identity/v3/role_assignments?user.id=32f11d0d46f94beba8913591371d5e33&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:03.071443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c721-abb4-4a7e-be45-4783ea502609 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:03.071833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c721-abb4-4a7e-be45-4783ea502609 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:03.072201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c721-abb4-4a7e-be45-4783ea502609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:03.082238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:03.093793 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a8d0c721-abb4-4a7e-be45-4783ea502609 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:03.095168 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a8d0c721-abb4-4a7e-be45-4783ea502609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:03.169904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f5976-8f7f-4e8b-89ad-b3ed646269df None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:03.192190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 438/875] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:03.208790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b39ab5-e08a-449a-8b8c-a732b7125f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:03.209945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b39ab5-e08a-449a-8b8c-a732b7125f13 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:03.210445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b39ab5-e08a-449a-8b8c-a732b7125f13 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:03.210952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b39ab5-e08a-449a-8b8c-a732b7125f13 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:03.211313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c721-abb4-4a7e-be45-4783ea502609 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:03.212131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b39ab5-e08a-449a-8b8c-a732b7125f13 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:03.212645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b39ab5-e08a-449a-8b8c-a732b7125f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:03.214416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b39ab5-e08a-449a-8b8c-a732b7125f13 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:03.220252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 438/876] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:03.232864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b39ab5-e08a-449a-8b8c-a732b7125f13 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:03.323386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:03.329150 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c721-abb4-4a7e-be45-4783ea502609 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:03.352206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:03.367414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b39ab5-e08a-449a-8b8c-a732b7125f13 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:03.373676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7f65f-9d5f-408f-954e-56591f55e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:03.374359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f65f-9d5f-408f-954e-56591f55e83d None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:03.374647 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f65f-9d5f-408f-954e-56591f55e83d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:03.374929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f65f-9d5f-408f-954e-56591f55e83d None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:03.375651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f65f-9d5f-408f-954e-56591f55e83d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:03.377087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f65f-9d5f-408f-954e-56591f55e83d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:03.410853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d4eac-2db5-460a-abba-75868d83a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:03.411970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d4eac-2db5-460a-abba-75868d83a394 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:03.412396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d4eac-2db5-460a-abba-75868d83a394 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:03.412813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d4eac-2db5-460a-abba-75868d83a394 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:03.413685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d4eac-2db5-460a-abba-75868d83a394 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:03.414132 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d4eac-2db5-460a-abba-75868d83a394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:03.415685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d4eac-2db5-460a-abba-75868d83a394 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:03.421758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 439/877] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:03.463082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 439/878] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:21:03 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:03.916112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2109e1-70e2-49a4-a8d0-64dd2ac9c2da None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:03.916626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2109e1-70e2-49a4-a8d0-64dd2ac9c2da None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:03.916705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2109e1-70e2-49a4-a8d0-64dd2ac9c2da None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:03.918831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 440/879] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:03.924321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ef040-7cec-40b0-ac5c-2bdb839c4d93 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:03.924616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ef040-7cec-40b0-ac5c-2bdb839c4d93 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:03.924898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ef040-7cec-40b0-ac5c-2bdb839c4d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:03.941815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d05ef040-7cec-40b0-ac5c-2bdb839c4d93 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:03.942996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d05ef040-7cec-40b0-ac5c-2bdb839c4d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:04.019286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 440/880] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:04.045068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2109e1-70e2-49a4-a8d0-64dd2ac9c2da None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:04.152898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2109e1-70e2-49a4-a8d0-64dd2ac9c2da None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:04.187584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6f44f-4cd3-4686-8297-259144511832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:04.188202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6f44f-4cd3-4686-8297-259144511832 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:04.188483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6f44f-4cd3-4686-8297-259144511832 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:04.188758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6f44f-4cd3-4686-8297-259144511832 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:04.189478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6f44f-4cd3-4686-8297-259144511832 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:04.190842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6f44f-4cd3-4686-8297-259144511832 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:04.308079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 441/881] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:21:04 2022] POST /identity/v3/services => generated 269 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:05.382819 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b45c2-acea-4734-9f67-0325e6322bf5 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:05.383885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b45c2-acea-4734-9f67-0325e6322bf5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:05.384375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b45c2-acea-4734-9f67-0325e6322bf5 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:05.386226 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 441/882] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:05.391906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f99c-4fc2-4b78-af78-fcf6a4fd9678 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:05.392781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f99c-4fc2-4b78-af78-fcf6a4fd9678 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:05.393262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84f99c-4fc2-4b78-af78-fcf6a4fd9678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:05.412960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-1d84f99c-4fc2-4b78-af78-fcf6a4fd9678 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:05.414516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1d84f99c-4fc2-4b78-af78-fcf6a4fd9678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:05.425770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:05.491168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 442/883] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:05.515668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b45c2-acea-4734-9f67-0325e6322bf5 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:05.594122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431400b-55a0-40ed-aa57-c5e958483823 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:05.594760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431400b-55a0-40ed-aa57-c5e958483823 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:05.595239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431400b-55a0-40ed-aa57-c5e958483823 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:05.597104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 443/884] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:05.603763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d69804-e695-41e2-9f41-5d89b4d8d455 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:05.603763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d69804-e695-41e2-9f41-5d89b4d8d455 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:05.603763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d69804-e695-41e2-9f41-5d89b4d8d455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:05.609813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:05.619084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-94d69804-e695-41e2-9f41-5d89b4d8d455 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:05.620283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-94d69804-e695-41e2-9f41-5d89b4d8d455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:05.632515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b45c2-acea-4734-9f67-0325e6322bf5 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:05.677643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e28e4-a11e-42bb-a1c7-19985c4e61d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:05.678817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e28e4-a11e-42bb-a1c7-19985c4e61d4 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:05.679301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e28e4-a11e-42bb-a1c7-19985c4e61d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:05.679866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e28e4-a11e-42bb-a1c7-19985c4e61d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:05.691386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e28e4-a11e-42bb-a1c7-19985c4e61d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:05.703277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 444/885] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-584e28e4-a11e-42bb-a1c7-19985c4e61d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:05.705015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:05.705918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:05.707265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 442/886] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 16 00:21:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:05.712018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d69804-e695-41e2-9f41-5d89b4d8d455 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:05.724162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e28e4-a11e-42bb-a1c7-19985c4e61d4 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:05.786490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:05.816172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d69804-e695-41e2-9f41-5d89b4d8d455 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:05.827564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e28e4-a11e-42bb-a1c7-19985c4e61d4 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:05.852434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4de372-67fd-40ca-a759-5f8d76a22521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:05.853103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de372-67fd-40ca-a759-5f8d76a22521 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:05.853386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de372-67fd-40ca-a759-5f8d76a22521 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:05.853666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de372-67fd-40ca-a759-5f8d76a22521 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:05.854397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4de372-67fd-40ca-a759-5f8d76a22521 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:05.854698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4de372-67fd-40ca-a759-5f8d76a22521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:05.856228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4de372-67fd-40ca-a759-5f8d76a22521 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:05.863340 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c2ed0-1aa0-4c6e-b5cc-038e61d1192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:05.864028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c2ed0-1aa0-4c6e-b5cc-038e61d1192d None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:05.868892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c2ed0-1aa0-4c6e-b5cc-038e61d1192d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:05.869026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 445/887] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 16 00:21:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:05.869105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c2ed0-1aa0-4c6e-b5cc-038e61d1192d None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:05.869105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c2ed0-1aa0-4c6e-b5cc-038e61d1192d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:05.869228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf852a9-a5bf-41fe-956f-96bfedb5d23f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:05.869228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf852a9-a5bf-41fe-956f-96bfedb5d23f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:05.869228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf852a9-a5bf-41fe-956f-96bfedb5d23f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:05.869422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c2ed0-1aa0-4c6e-b5cc-038e61d1192d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:05.869489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 446/888] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:05.869739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf852a9-a5bf-41fe-956f-96bfedb5d23f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:05.941764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 443/889] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:21:05 2022] POST /identity/v3/services => generated 241 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:21:05.943043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b1aa-7200-4c2b-9374-7faf47bb0dfe None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:05.943336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b1aa-7200-4c2b-9374-7faf47bb0dfe None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:05.943659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b1aa-7200-4c2b-9374-7faf47bb0dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:05.964114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:05.972238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-da59b1aa-7200-4c2b-9374-7faf47bb0dfe None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:05.974059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-da59b1aa-7200-4c2b-9374-7faf47bb0dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:05.985456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf852a9-a5bf-41fe-956f-96bfedb5d23f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.021449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:06.033709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82d42e-837c-4863-b5ba-1858eaf54b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.034560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d42e-837c-4863-b5ba-1858eaf54b25 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.034844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d42e-837c-4863-b5ba-1858eaf54b25 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.035115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d42e-837c-4863-b5ba-1858eaf54b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.049216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82d42e-837c-4863-b5ba-1858eaf54b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:06.051077 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82d42e-837c-4863-b5ba-1858eaf54b25 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:06.067270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 444/890] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-8d82d42e-837c-4863-b5ba-1858eaf54b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:06.071107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:06.071997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:06.072890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:06.072890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:06.072890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:06.072890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:06.077874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 447/891] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:06.080871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59b1aa-7200-4c2b-9374-7faf47bb0dfe None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:06.094113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82d42e-837c-4863-b5ba-1858eaf54b25 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:06.201638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59b1aa-7200-4c2b-9374-7faf47bb0dfe None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.215156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82d42e-837c-4863-b5ba-1858eaf54b25 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.247520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:06.255809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6b731-9765-4a6c-9932-95d2124ed2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.261273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6b731-9765-4a6c-9932-95d2124ed2e3 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.261273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6b731-9765-4a6c-9932-95d2124ed2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.261273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6b731-9765-4a6c-9932-95d2124ed2e3 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.261273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6b731-9765-4a6c-9932-95d2124ed2e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:06.261273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6b731-9765-4a6c-9932-95d2124ed2e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:06.261648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad594b-18f1-4a3b-8e51-8d5469c65f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.261744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6b731-9765-4a6c-9932-95d2124ed2e3 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:06.261823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad594b-18f1-4a3b-8e51-8d5469c65f71 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.261823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad594b-18f1-4a3b-8e51-8d5469c65f71 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.261823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad594b-18f1-4a3b-8e51-8d5469c65f71 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.261823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad594b-18f1-4a3b-8e51-8d5469c65f71 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:06.263202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad594b-18f1-4a3b-8e51-8d5469c65f71 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:06.272625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 445/892] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-efad594b-18f1-4a3b-8e51-8d5469c65f71 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:06.275673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:06.277426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:21:06.278682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:06.281152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 448/893] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:21:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:06.282001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6b731-9765-4a6c-9932-95d2124ed2e3 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:06.286877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad594b-18f1-4a3b-8e51-8d5469c65f71 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:06.335289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:06.394393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad594b-18f1-4a3b-8e51-8d5469c65f71 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.420959 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6b731-9765-4a6c-9932-95d2124ed2e3 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.435105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809eb6-59c5-43a5-994a-42b8e582ac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.436375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809eb6-59c5-43a5-994a-42b8e582ac75 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.436889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809eb6-59c5-43a5-994a-42b8e582ac75 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.437383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809eb6-59c5-43a5-994a-42b8e582ac75 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.438288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809eb6-59c5-43a5-994a-42b8e582ac75 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:06.438882 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809eb6-59c5-43a5-994a-42b8e582ac75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:06.440665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809eb6-59c5-43a5-994a-42b8e582ac75 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:06.451793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 449/894] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:21:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:06.453014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809eb6-59c5-43a5-994a-42b8e582ac75 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:06.462667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45049938-ad37-4079-a6be-0e51e12ca70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.464040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45049938-ad37-4079-a6be-0e51e12ca70a None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.464886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45049938-ad37-4079-a6be-0e51e12ca70a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.465165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45049938-ad37-4079-a6be-0e51e12ca70a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.475660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45049938-ad37-4079-a6be-0e51e12ca70a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:06.477544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45049938-ad37-4079-a6be-0e51e12ca70a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-45049938-ad37-4079-a6be-0e51e12ca70a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:21:06.497795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:06.498758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:21:06.499674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:06.500683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 446/895] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:21:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:06.501035 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790ec1a-f29f-4b3f-8e9c-ea261dba58ab None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.501322 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790ec1a-f29f-4b3f-8e9c-ea261dba58ab None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.501598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790ec1a-f29f-4b3f-8e9c-ea261dba58ab None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.503843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 447/896] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:06.508950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790ec1a-f29f-4b3f-8e9c-ea261dba58ab None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:06.561203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:06.566057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809eb6-59c5-43a5-994a-42b8e582ac75 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.576059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:06.602507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25fdc-1f5e-4443-89b7-1dc0fbbab35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.603489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25fdc-1f5e-4443-89b7-1dc0fbbab35d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.603813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25fdc-1f5e-4443-89b7-1dc0fbbab35d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.604251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25fdc-1f5e-4443-89b7-1dc0fbbab35d None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.605015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25fdc-1f5e-4443-89b7-1dc0fbbab35d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:06.605324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25fdc-1f5e-4443-89b7-1dc0fbbab35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:06.606748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25fdc-1f5e-4443-89b7-1dc0fbbab35d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:06.610360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790ec1a-f29f-4b3f-8e9c-ea261dba58ab None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.616311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 450/897] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:21:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:06.616311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba7e26-955f-48a7-9a06-cf75078c2edc None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.616311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba7e26-955f-48a7-9a06-cf75078c2edc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.616311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba7e26-955f-48a7-9a06-cf75078c2edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.630371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7bba7e26-955f-48a7-9a06-cf75078c2edc None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:06.631850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7bba7e26-955f-48a7-9a06-cf75078c2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:06.655532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c0476-a160-477e-a84b-0f951be9e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.656484 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0476-a160-477e-a84b-0f951be9e8ae None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.657177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0476-a160-477e-a84b-0f951be9e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.657464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0476-a160-477e-a84b-0f951be9e8ae None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.658561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0476-a160-477e-a84b-0f951be9e8ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:06.659120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0476-a160-477e-a84b-0f951be9e8ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:06.661272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0476-a160-477e-a84b-0f951be9e8ae None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:06.683587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 448/898] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 16 00:21:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:06.684651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c0476-a160-477e-a84b-0f951be9e8ae None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:06.705954 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 451/899] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:06.706841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba7e26-955f-48a7-9a06-cf75078c2edc None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:06.797936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c0476-a160-477e-a84b-0f951be9e8ae None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.810510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:06.824896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba7e26-955f-48a7-9a06-cf75078c2edc None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.826881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:06.834482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8534b-72c8-43b8-aa31-0d9463a8ff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.835229 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8534b-72c8-43b8-aa31-0d9463a8ff03 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.835575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8534b-72c8-43b8-aa31-0d9463a8ff03 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.835950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8534b-72c8-43b8-aa31-0d9463a8ff03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.836782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8534b-72c8-43b8-aa31-0d9463a8ff03 None admin] RBAC: Adding query filter params (interface=public, service_id=4214f0ae640d4875b7ba4efafe9d0617, region_id=RegionOne) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:06.837138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8534b-72c8-43b8-aa31-0d9463a8ff03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:06.838468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8534b-72c8-43b8-aa31-0d9463a8ff03 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:06.844527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 449/900] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 16 00:21:06 2022] GET /identity/v3/endpoints?service_id=4214f0ae640d4875b7ba4efafe9d0617&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:06.845609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8534b-72c8-43b8-aa31-0d9463a8ff03 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:06.861820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740437-61d8-40d9-9fd7-b68312c54724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.862472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740437-61d8-40d9-9fd7-b68312c54724 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.862755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740437-61d8-40d9-9fd7-b68312c54724 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.863034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740437-61d8-40d9-9fd7-b68312c54724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.932384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af740437-61d8-40d9-9fd7-b68312c54724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:06.934428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af740437-61d8-40d9-9fd7-b68312c54724 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:06.961431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8534b-72c8-43b8-aa31-0d9463a8ff03 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:06.996938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b69d61-ee46-4d66-8680-c158c46521e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:06.997833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b69d61-ee46-4d66-8680-c158c46521e2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:06.998117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b69d61-ee46-4d66-8680-c158c46521e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:06.998394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b69d61-ee46-4d66-8680-c158c46521e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:06.999041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b69d61-ee46-4d66-8680-c158c46521e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.000440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b69d61-ee46-4d66-8680-c158c46521e2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-67b69d61-ee46-4d66-8680-c158c46521e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:07.014179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:07.015095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:07.016306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 450/901] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Jun 16 00:21:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:07.017150 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b69d61-ee46-4d66-8680-c158c46521e2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:07.051087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 452/902] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:06 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:07.051087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740437-61d8-40d9-9fd7-b68312c54724 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:07.051087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:07.068154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:07.137581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b69d61-ee46-4d66-8680-c158c46521e2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:07.154171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740437-61d8-40d9-9fd7-b68312c54724 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:07.175965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10d72c-8cec-49cb-b4f8-a874e8799b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:07.176710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10d72c-8cec-49cb-b4f8-a874e8799b5d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:07.176915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10d72c-8cec-49cb-b4f8-a874e8799b5d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:07.177170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10d72c-8cec-49cb-b4f8-a874e8799b5d None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:07.178047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10d72c-8cec-49cb-b4f8-a874e8799b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.179211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10d72c-8cec-49cb-b4f8-a874e8799b5d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.186242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 451/903] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:21:07.186877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10d72c-8cec-49cb-b4f8-a874e8799b5d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:07.199790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999875-25d9-4e70-b1a3-07d1e9f10163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:07.199790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999875-25d9-4e70-b1a3-07d1e9f10163 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:07.199790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999875-25d9-4e70-b1a3-07d1e9f10163 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:07.199790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb999875-25d9-4e70-b1a3-07d1e9f10163 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:07.200239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb999875-25d9-4e70-b1a3-07d1e9f10163 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:07.200239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb999875-25d9-4e70-b1a3-07d1e9f10163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.202498 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb999875-25d9-4e70-b1a3-07d1e9f10163 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.212018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 453/904] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:07.216876 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999875-25d9-4e70-b1a3-07d1e9f10163 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:07.292008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:07.313388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10d72c-8cec-49cb-b4f8-a874e8799b5d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:07.330013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb999875-25d9-4e70-b1a3-07d1e9f10163 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:07.340259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:07.354385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f88d62-44f5-447a-ad6b-a7cee4cd4bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:07.355844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f88d62-44f5-447a-ad6b-a7cee4cd4bd7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:07.356129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f88d62-44f5-447a-ad6b-a7cee4cd4bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:07.356402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f88d62-44f5-447a-ad6b-a7cee4cd4bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:07.373703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f88d62-44f5-447a-ad6b-a7cee4cd4bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.374643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578ebcc-3f71-4e0a-8a01-0799e324c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:07.375305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578ebcc-3f71-4e0a-8a01-0799e324c338 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:07.375633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578ebcc-3f71-4e0a-8a01-0799e324c338 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:07.375775 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f88d62-44f5-447a-ad6b-a7cee4cd4bd7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.376124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578ebcc-3f71-4e0a-8a01-0799e324c338 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:07.376812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578ebcc-3f71-4e0a-8a01-0799e324c338 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:07.377119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578ebcc-3f71-4e0a-8a01-0799e324c338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.379096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578ebcc-3f71-4e0a-8a01-0799e324c338 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.385686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 454/905] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:07.391902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578ebcc-3f71-4e0a-8a01-0799e324c338 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-41f88d62-44f5-447a-ad6b-a7cee4cd4bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:07.398871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:07.399754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:07.400626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:07.400626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:07.400626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:07.400626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:07.401270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 452/906] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:07.406680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f88d62-44f5-447a-ad6b-a7cee4cd4bd7 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:07.502965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578ebcc-3f71-4e0a-8a01-0799e324c338 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:07.523559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f88d62-44f5-447a-ad6b-a7cee4cd4bd7 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:07.532305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:07.538345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a5fc-bece-4586-8bda-4d462d3d1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:07.539087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a5fc-bece-4586-8bda-4d462d3d1141 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:07.539442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a5fc-bece-4586-8bda-4d462d3d1141 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:07.539859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a5fc-bece-4586-8bda-4d462d3d1141 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:07.540796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a5fc-bece-4586-8bda-4d462d3d1141 None admin] RBAC: Adding query filter params (interface=public, service_id=10357dc1cff048859d38dfc6f6beeb9f, region_id=RegionOne) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:07.541190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a5fc-bece-4586-8bda-4d462d3d1141 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.543197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a5fc-bece-4586-8bda-4d462d3d1141 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.548770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 455/907] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/endpoints?service_id=10357dc1cff048859d38dfc6f6beeb9f&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:07.554131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a5fc-bece-4586-8bda-4d462d3d1141 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:07.560851 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd75ba-8532-41ce-b9bc-8c3a5297de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:07.561514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd75ba-8532-41ce-b9bc-8c3a5297de2b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:07.561796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd75ba-8532-41ce-b9bc-8c3a5297de2b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:07.562068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd75ba-8532-41ce-b9bc-8c3a5297de2b None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:07.562844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd75ba-8532-41ce-b9bc-8c3a5297de2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:07.563158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd75ba-8532-41ce-b9bc-8c3a5297de2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.564619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd75ba-8532-41ce-b9bc-8c3a5297de2b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.577713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 453/908] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:07.582968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd75ba-8532-41ce-b9bc-8c3a5297de2b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:07.600386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:07.657065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a5fc-bece-4586-8bda-4d462d3d1141 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:07.692616 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bd41b-ae7a-4d4a-84d3-36057023db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:07.693490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd41b-ae7a-4d4a-84d3-36057023db79 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:07.693847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd41b-ae7a-4d4a-84d3-36057023db79 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:07.694253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd41b-ae7a-4d4a-84d3-36057023db79 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:07.694937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bd41b-ae7a-4d4a-84d3-36057023db79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.696413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bd41b-ae7a-4d4a-84d3-36057023db79 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.696876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd75ba-8532-41ce-b9bc-8c3a5297de2b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:07.717561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 456/909] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:21:07.737681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01529bfd-003b-45ee-af8d-8241f40b74db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:07.738496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01529bfd-003b-45ee-af8d-8241f40b74db None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:07.738779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01529bfd-003b-45ee-af8d-8241f40b74db None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:07.739054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01529bfd-003b-45ee-af8d-8241f40b74db None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:07.747097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01529bfd-003b-45ee-af8d-8241f40b74db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.748620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01529bfd-003b-45ee-af8d-8241f40b74db None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-01529bfd-003b-45ee-af8d-8241f40b74db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:21:07.764217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:07.765126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:07.766001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:21:07.766001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:21:07.766001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:21:07.766001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:21:07.766001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:21:07.766001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:21:07.766001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:07.766001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:07.766001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 454/910] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:07.771613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bd41b-ae7a-4d4a-84d3-36057023db79 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:07.848026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:07.894296 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bd41b-ae7a-4d4a-84d3-36057023db79 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:07.929891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37540133-3214-48f8-9043-03e2c9bfe032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:07.930648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37540133-3214-48f8-9043-03e2c9bfe032 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:07.931007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37540133-3214-48f8-9043-03e2c9bfe032 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:07.931356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37540133-3214-48f8-9043-03e2c9bfe032 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:07.932250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37540133-3214-48f8-9043-03e2c9bfe032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:07.932635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37540133-3214-48f8-9043-03e2c9bfe032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:07.934165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37540133-3214-48f8-9043-03e2c9bfe032 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:07.947200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 457/911] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:07.953489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01529bfd-003b-45ee-af8d-8241f40b74db None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:08.034358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:08.060601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01529bfd-003b-45ee-af8d-8241f40b74db None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:08.096312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e04b-9436-41ed-9749-ae443283f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:08.097256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e04b-9436-41ed-9749-ae443283f073 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:08.097679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e04b-9436-41ed-9749-ae443283f073 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:08.098092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e04b-9436-41ed-9749-ae443283f073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:08.099050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e04b-9436-41ed-9749-ae443283f073 None admin] RBAC: Adding query filter params (role.id=f67c45ce861841519313d6585e5bd3fe, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=32f11d0d46f94beba8913591371d5e33) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:08.099527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e04b-9436-41ed-9749-ae443283f073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:08.101125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e04b-9436-41ed-9749-ae443283f073 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:08.107238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 455/912] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:07 2022] GET /identity/v3/role_assignments?user.id=32f11d0d46f94beba8913591371d5e33&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=f67c45ce861841519313d6585e5bd3fe => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:08.225456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd5c1b-69eb-4889-a7c7-dd48a9c6df19 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:08.225742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd5c1b-69eb-4889-a7c7-dd48a9c6df19 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:08.226022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd5c1b-69eb-4889-a7c7-dd48a9c6df19 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:08.227423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 458/913] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:08.233407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e249014-2915-42c6-acd1-d30ec7a90d37 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:08.233692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e249014-2915-42c6-acd1-d30ec7a90d37 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:08.233972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e249014-2915-42c6-acd1-d30ec7a90d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:08.258176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-1e249014-2915-42c6-acd1-d30ec7a90d37 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:08.259384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1e249014-2915-42c6-acd1-d30ec7a90d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:08.337110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 456/914] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:08.359965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd5c1b-69eb-4889-a7c7-dd48a9c6df19 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:08.467462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd5c1b-69eb-4889-a7c7-dd48a9c6df19 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:08.485366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:08.502364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21045c-7b8d-4814-86e7-91dd2de75696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:08.503340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21045c-7b8d-4814-86e7-91dd2de75696 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:08.503882 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21045c-7b8d-4814-86e7-91dd2de75696 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:08.503961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21045c-7b8d-4814-86e7-91dd2de75696 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:08.504628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21045c-7b8d-4814-86e7-91dd2de75696 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:08.513489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21045c-7b8d-4814-86e7-91dd2de75696 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-de21045c-7b8d-4814-86e7-91dd2de75696 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:08.519452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:08.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:08.521245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:08.526575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 459/915] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:08.527984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e249014-2915-42c6-acd1-d30ec7a90d37 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:08.596047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:08.630178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e249014-2915-42c6-acd1-d30ec7a90d37 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:08.666788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac03db-e615-4509-b988-69a8e522955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:08.668014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac03db-e615-4509-b988-69a8e522955e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:08.668294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac03db-e615-4509-b988-69a8e522955e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:08.668566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac03db-e615-4509-b988-69a8e522955e None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:08.669270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac03db-e615-4509-b988-69a8e522955e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:08.669576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac03db-e615-4509-b988-69a8e522955e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:08.670944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac03db-e615-4509-b988-69a8e522955e None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:08.676158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 457/916] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:08.681684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21045c-7b8d-4814-86e7-91dd2de75696 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:08.783972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21045c-7b8d-4814-86e7-91dd2de75696 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:08.819119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17843d57-2895-41f7-9f1a-bb2b22ce9c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:08.819877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17843d57-2895-41f7-9f1a-bb2b22ce9c2e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:08.820169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17843d57-2895-41f7-9f1a-bb2b22ce9c2e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:08.820440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17843d57-2895-41f7-9f1a-bb2b22ce9c2e None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:08.821147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17843d57-2895-41f7-9f1a-bb2b22ce9c2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:08.821456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17843d57-2895-41f7-9f1a-bb2b22ce9c2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:08.822828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17843d57-2895-41f7-9f1a-bb2b22ce9c2e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:08.832163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 460/917] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:08.834771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac03db-e615-4509-b988-69a8e522955e None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:08.945204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac03db-e615-4509-b988-69a8e522955e None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:08.976400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:08.982672 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c34c04-2c1f-4c9c-9136-a0d94bdce4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:08.983710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c34c04-2c1f-4c9c-9136-a0d94bdce4be None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:08.984220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c34c04-2c1f-4c9c-9136-a0d94bdce4be None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:08.984707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c34c04-2c1f-4c9c-9136-a0d94bdce4be None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:08.985678 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c34c04-2c1f-4c9c-9136-a0d94bdce4be None admin] RBAC: Adding query filter params (interface=public, service_id=145914dd878a4d16ac5ca94c45fa462b, region_id=RegionOne) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:08.986150 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c34c04-2c1f-4c9c-9136-a0d94bdce4be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:08.987784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c34c04-2c1f-4c9c-9136-a0d94bdce4be None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:08.994229 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 458/918] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 16 00:21:08 2022] GET /identity/v3/endpoints?service_id=145914dd878a4d16ac5ca94c45fa462b&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:09.002284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17843d57-2895-41f7-9f1a-bb2b22ce9c2e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:09.056977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:09.106693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17843d57-2895-41f7-9f1a-bb2b22ce9c2e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:09.140062 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a9c2-9fe1-4e81-ad7d-42816e34b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:09.140774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a9c2-9fe1-4e81-ad7d-42816e34b73d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:09.141059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a9c2-9fe1-4e81-ad7d-42816e34b73d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:09.141334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a9c2-9fe1-4e81-ad7d-42816e34b73d None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:09.142002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812a9c2-9fe1-4e81-ad7d-42816e34b73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:09.143357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812a9c2-9fe1-4e81-ad7d-42816e34b73d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:09.149701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 461/919] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 16 00:21:08 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:21:09.488289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af442a8-2d64-4cba-9680-d6ac82d6ecfc None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:09.488584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af442a8-2d64-4cba-9680-d6ac82d6ecfc None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:09.488866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af442a8-2d64-4cba-9680-d6ac82d6ecfc None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:09.490466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 459/920] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:09.495886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070bf8c-580e-4cb7-b078-c0b020fade42 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:09.496229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070bf8c-580e-4cb7-b078-c0b020fade42 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:09.496461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070bf8c-580e-4cb7-b078-c0b020fade42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:09.514148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0070bf8c-580e-4cb7-b078-c0b020fade42 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:09.515342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0070bf8c-580e-4cb7-b078-c0b020fade42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:09.584002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 462/921] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:09.610953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af442a8-2d64-4cba-9680-d6ac82d6ecfc None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:09.720301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af442a8-2d64-4cba-9680-d6ac82d6ecfc None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:09.756154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70f793-0908-4d74-b335-2d6f719c8704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:09.757555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70f793-0908-4d74-b335-2d6f719c8704 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:09.758026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70f793-0908-4d74-b335-2d6f719c8704 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:09.758486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70f793-0908-4d74-b335-2d6f719c8704 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:09.759315 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70f793-0908-4d74-b335-2d6f719c8704 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:09.761439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70f793-0908-4d74-b335-2d6f719c8704 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-7e70f793-0908-4d74-b335-2d6f719c8704 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:09.773425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:09.774495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:21:09.775409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:09.778306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 460/922] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:21:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:09.785911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070bf8c-580e-4cb7-b078-c0b020fade42 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:09.827837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:09.893539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070bf8c-580e-4cb7-b078-c0b020fade42 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:09.922333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929cde8-38f2-4a63-a14b-b94ee9dae563 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:09.922698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929cde8-38f2-4a63-a14b-b94ee9dae563 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:09.922990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929cde8-38f2-4a63-a14b-b94ee9dae563 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:09.925020 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 461/923] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:09.928758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e555d4e-d9d3-4660-88a4-fa532bcae283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:09.929535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e555d4e-d9d3-4660-88a4-fa532bcae283 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:09.929740 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e555d4e-d9d3-4660-88a4-fa532bcae283 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:09.929990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e555d4e-d9d3-4660-88a4-fa532bcae283 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:09.930683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bb52-b595-4db9-95a3-0c25c516fa9d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:09.930799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e555d4e-d9d3-4660-88a4-fa532bcae283 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:09.930961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bb52-b595-4db9-95a3-0c25c516fa9d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:09.931059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e555d4e-d9d3-4660-88a4-fa532bcae283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:09.931241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bb52-b595-4db9-95a3-0c25c516fa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:09.932493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e555d4e-d9d3-4660-88a4-fa532bcae283 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:09.938574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 463/924] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:21:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:09.943946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e555d4e-d9d3-4660-88a4-fa532bcae283 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:09.950680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-1d67bb52-b595-4db9-95a3-0c25c516fa9d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:09.952014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1d67bb52-b595-4db9-95a3-0c25c516fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:10.022841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:10.041513 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 462/925] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:10.059974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e555d4e-d9d3-4660-88a4-fa532bcae283 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:10.060885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67bb52-b595-4db9-95a3-0c25c516fa9d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:10.062374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:10.094448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90f487-8361-478a-802f-d5e139b84457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:10.095221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90f487-8361-478a-802f-d5e139b84457 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.095520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90f487-8361-478a-802f-d5e139b84457 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.095824 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90f487-8361-478a-802f-d5e139b84457 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.096636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90f487-8361-478a-802f-d5e139b84457 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:10.096950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90f487-8361-478a-802f-d5e139b84457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:10.098322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90f487-8361-478a-802f-d5e139b84457 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:10.104424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 464/926] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 16 00:21:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:10.110194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90f487-8361-478a-802f-d5e139b84457 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:10.177876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67bb52-b595-4db9-95a3-0c25c516fa9d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:10.214984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a1ac-ac63-4eb4-9b35-ee82d592aa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:10.216179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a1ac-ac63-4eb4-9b35-ee82d592aa62 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.216615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a1ac-ac63-4eb4-9b35-ee82d592aa62 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.217096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a1ac-ac63-4eb4-9b35-ee82d592aa62 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.217936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a1ac-ac63-4eb4-9b35-ee82d592aa62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:10.219518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a1ac-ac63-4eb4-9b35-ee82d592aa62 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-80b2a1ac-ac63-4eb4-9b35-ee82d592aa62 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:10.233282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:10.234249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:21:10.235082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:10.238037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 463/927] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Jun 16 00:21:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:10.244636 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a1ac-ac63-4eb4-9b35-ee82d592aa62 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:10.249342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90f487-8361-478a-802f-d5e139b84457 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:10.286474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29f875-64f6-4d87-883d-cd941e84e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:10.287472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29f875-64f6-4d87-883d-cd941e84e25d None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.288073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29f875-64f6-4d87-883d-cd941e84e25d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.288572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29f875-64f6-4d87-883d-cd941e84e25d None admin] PATH_INFO: `/v3/endpoints` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.289631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29f875-64f6-4d87-883d-cd941e84e25d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:10.291432 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29f875-64f6-4d87-883d-cd941e84e25d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:10.320569 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:10.366422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a1ac-ac63-4eb4-9b35-ee82d592aa62 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:10.397988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 465/928] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 16 00:21:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:10.397988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b34038-e332-4e8b-bf11-400bbcfed926 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.397988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b34038-e332-4e8b-bf11-400bbcfed926 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.397988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b34038-e332-4e8b-bf11-400bbcfed926 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.400457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 466/929] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:10.402682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467084ac-d1d1-4c5a-84f7-d6251e1a4fc7 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.403214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467084ac-d1d1-4c5a-84f7-d6251e1a4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.403677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467084ac-d1d1-4c5a-84f7-d6251e1a4fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.417687 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62732ebb-a291-45a7-98ab-e6c9df8d7ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:10.418611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62732ebb-a291-45a7-98ab-e6c9df8d7ad7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.418906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62732ebb-a291-45a7-98ab-e6c9df8d7ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.419184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62732ebb-a291-45a7-98ab-e6c9df8d7ad7 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.420034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62732ebb-a291-45a7-98ab-e6c9df8d7ad7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:10.420344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62732ebb-a291-45a7-98ab-e6c9df8d7ad7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:10.421994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62732ebb-a291-45a7-98ab-e6c9df8d7ad7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:10.424089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-467084ac-d1d1-4c5a-84f7-d6251e1a4fc7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:10.425593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-467084ac-d1d1-4c5a-84f7-d6251e1a4fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:10.428385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 464/930] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:10.435569 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62732ebb-a291-45a7-98ab-e6c9df8d7ad7 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:10.445394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:10.508114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 467/931] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:10.524934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467084ac-d1d1-4c5a-84f7-d6251e1a4fc7 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:10.578808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62732ebb-a291-45a7-98ab-e6c9df8d7ad7 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:10.599758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:10.628257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ee910-61eb-4122-9271-2a324285f4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:10.629828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ee910-61eb-4122-9271-2a324285f4da None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.631084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ee910-61eb-4122-9271-2a324285f4da None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.631903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ee910-61eb-4122-9271-2a324285f4da None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.632992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ee910-61eb-4122-9271-2a324285f4da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:10.633302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ee910-61eb-4122-9271-2a324285f4da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:10.634674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ee910-61eb-4122-9271-2a324285f4da None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:10.639191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467084ac-d1d1-4c5a-84f7-d6251e1a4fc7 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:10.639798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 465/932] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:10.645727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ee910-61eb-4122-9271-2a324285f4da None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:10.679378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde0612-6dd9-4e92-89e0-bbe7d166bdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:10.680246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde0612-6dd9-4e92-89e0-bbe7d166bdbe None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.680696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde0612-6dd9-4e92-89e0-bbe7d166bdbe None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.680799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde0612-6dd9-4e92-89e0-bbe7d166bdbe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.693494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde0612-6dd9-4e92-89e0-bbe7d166bdbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-3fde0612-6dd9-4e92-89e0-bbe7d166bdbe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:10.702231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:10.703179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:10.704104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 468/933] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 16 00:21:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:10.710864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde0612-6dd9-4e92-89e0-bbe7d166bdbe None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:10.728147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:10.772315 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ee910-61eb-4122-9271-2a324285f4da None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:10.817444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe937ec0-697b-4460-b3b0-58fec1903698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:10.818440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe937ec0-697b-4460-b3b0-58fec1903698 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.818896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe937ec0-697b-4460-b3b0-58fec1903698 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.819359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe937ec0-697b-4460-b3b0-58fec1903698 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.819463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde0612-6dd9-4e92-89e0-bbe7d166bdbe None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:10.820449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe937ec0-697b-4460-b3b0-58fec1903698 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:10.823056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe937ec0-697b-4460-b3b0-58fec1903698 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:10.856526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba57ce4-8e09-4345-a8a4-f303095abe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:10.857216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba57ce4-8e09-4345-a8a4-f303095abe9f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:10.857637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba57ce4-8e09-4345-a8a4-f303095abe9f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:10.857985 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba57ce4-8e09-4345-a8a4-f303095abe9f None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:10.858851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba57ce4-8e09-4345-a8a4-f303095abe9f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:10.859225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba57ce4-8e09-4345-a8a4-f303095abe9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:10.860697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba57ce4-8e09-4345-a8a4-f303095abe9f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:10.874187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 469/934] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 16 00:21:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:10.875543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba57ce4-8e09-4345-a8a4-f303095abe9f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:10.903206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 466/935] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 16 00:21:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:21:10.968006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:10.995558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba57ce4-8e09-4345-a8a4-f303095abe9f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:11.055786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810dce8-ee43-45ae-b67b-cabb63a8ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:11.056600 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810dce8-ee43-45ae-b67b-cabb63a8ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:11.056881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810dce8-ee43-45ae-b67b-cabb63a8ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:11.057155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810dce8-ee43-45ae-b67b-cabb63a8ddc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:11.069581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810dce8-ee43-45ae-b67b-cabb63a8ddc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:11.071058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810dce8-ee43-45ae-b67b-cabb63a8ddc2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-f810dce8-ee43-45ae-b67b-cabb63a8ddc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:11.090622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:11.091645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:11.092761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:11.092761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:11.092761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:11.092761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:11.092761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 470/936] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:11.097549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe937ec0-697b-4460-b3b0-58fec1903698 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:11.133408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:11.203584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe937ec0-697b-4460-b3b0-58fec1903698 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:11.242574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb505e10-7361-4b50-aaf2-2a3d92bfd849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:11.243256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb505e10-7361-4b50-aaf2-2a3d92bfd849 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:11.243537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb505e10-7361-4b50-aaf2-2a3d92bfd849 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:11.243865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb505e10-7361-4b50-aaf2-2a3d92bfd849 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:11.244590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb505e10-7361-4b50-aaf2-2a3d92bfd849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:11.244898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb505e10-7361-4b50-aaf2-2a3d92bfd849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:11.246847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb505e10-7361-4b50-aaf2-2a3d92bfd849 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:11.263948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 467/937] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:11.265906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810dce8-ee43-45ae-b67b-cabb63a8ddc2 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:11.372955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa61a-87ae-462a-9d6b-73dd77550d9b None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:11.373284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa61a-87ae-462a-9d6b-73dd77550d9b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:11.373512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa61a-87ae-462a-9d6b-73dd77550d9b None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:11.375005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 468/938] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:11.379892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e3a9-09b7-47ec-9c6e-c3a93db20e17 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:11.380234 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e3a9-09b7-47ec-9c6e-c3a93db20e17 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:11.380515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e3a9-09b7-47ec-9c6e-c3a93db20e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:11.382616 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810dce8-ee43-45ae-b67b-cabb63a8ddc2 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:11.398019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-0b64e3a9-09b7-47ec-9c6e-c3a93db20e17 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:11.398896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0b64e3a9-09b7-47ec-9c6e-c3a93db20e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:11.408183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:11.419464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e222e09-198a-4af6-94a3-0cb3de456522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:11.421312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e222e09-198a-4af6-94a3-0cb3de456522 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:11.421312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e222e09-198a-4af6-94a3-0cb3de456522 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:11.421312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e222e09-198a-4af6-94a3-0cb3de456522 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:11.431762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e222e09-198a-4af6-94a3-0cb3de456522 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:11.434021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e222e09-198a-4af6-94a3-0cb3de456522 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-6e222e09-198a-4af6-94a3-0cb3de456522 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:21:11.454762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:11.456125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:21:11.457298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:11.460018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 471/939] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:21:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:11.465468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e222e09-198a-4af6-94a3-0cb3de456522 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:11.477366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 469/940] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:11.500098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64e3a9-09b7-47ec-9c6e-c3a93db20e17 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:11.526631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:11.599420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e222e09-198a-4af6-94a3-0cb3de456522 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:11.609707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64e3a9-09b7-47ec-9c6e-c3a93db20e17 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:11.636764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcb9c3-c5d3-4a8e-888c-a6fa62783112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:11.637615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcb9c3-c5d3-4a8e-888c-a6fa62783112 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:11.637989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcb9c3-c5d3-4a8e-888c-a6fa62783112 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:11.638365 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcb9c3-c5d3-4a8e-888c-a6fa62783112 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:11.639309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcb9c3-c5d3-4a8e-888c-a6fa62783112 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:11.639720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcb9c3-c5d3-4a8e-888c-a6fa62783112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:11.641565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcb9c3-c5d3-4a8e-888c-a6fa62783112 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:11.659753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073cad2-a82e-44e6-b140-5258548ac135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:11.661135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073cad2-a82e-44e6-b140-5258548ac135 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:11.661570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073cad2-a82e-44e6-b140-5258548ac135 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:11.661987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073cad2-a82e-44e6-b140-5258548ac135 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:11.662787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073cad2-a82e-44e6-b140-5258548ac135 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:11.664363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073cad2-a82e-44e6-b140-5258548ac135 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:11.665837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 472/941] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 16 00:21:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:11.666853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcb9c3-c5d3-4a8e-888c-a6fa62783112 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-5073cad2-a82e-44e6-b140-5258548ac135 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:11.685004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:11.686264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:11.687290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:11.690597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 470/942] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:11.696479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073cad2-a82e-44e6-b140-5258548ac135 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:11.728919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:11.797335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:11.806952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcb9c3-c5d3-4a8e-888c-a6fa62783112 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:11.813039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073cad2-a82e-44e6-b140-5258548ac135 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:11.846473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33384-e70e-4471-9be1-74f883b18e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:11.847294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33384-e70e-4471-9be1-74f883b18e21 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:11.847576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33384-e70e-4471-9be1-74f883b18e21 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:11.848190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33384-e70e-4471-9be1-74f883b18e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:11.858519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c3482-07bf-4db5-9e8e-0adbb915117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:11.859523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c3482-07bf-4db5-9e8e-0adbb915117b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:11.859909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c3482-07bf-4db5-9e8e-0adbb915117b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:11.860072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d33384-e70e-4471-9be1-74f883b18e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:11.860313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c3482-07bf-4db5-9e8e-0adbb915117b None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:11.861103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c3482-07bf-4db5-9e8e-0adbb915117b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:11.861481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c3482-07bf-4db5-9e8e-0adbb915117b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:11.862271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d33384-e70e-4471-9be1-74f883b18e21 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:11.863004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c3482-07bf-4db5-9e8e-0adbb915117b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:11.871760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 471/943] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:11.875556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c3482-07bf-4db5-9e8e-0adbb915117b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-19d33384-e70e-4471-9be1-74f883b18e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:11.886323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:11.887236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:11.888525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:11.888525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:11.888525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:11.888525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:11.892060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 473/944] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:11.892872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33384-e70e-4471-9be1-74f883b18e21 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:11.998117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c3482-07bf-4db5-9e8e-0adbb915117b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:12.001554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:12.008926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33384-e70e-4471-9be1-74f883b18e21 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:12.034948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a984f1f-01c8-43cf-af4d-49c9d0dffab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:12.035898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a984f1f-01c8-43cf-af4d-49c9d0dffab9 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.036186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a984f1f-01c8-43cf-af4d-49c9d0dffab9 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.036464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a984f1f-01c8-43cf-af4d-49c9d0dffab9 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.039405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a984f1f-01c8-43cf-af4d-49c9d0dffab9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:12.039405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a984f1f-01c8-43cf-af4d-49c9d0dffab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:12.039405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a984f1f-01c8-43cf-af4d-49c9d0dffab9 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:12.050152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 472/945] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:12.051951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f3326-c7ab-449a-94fd-7d57d9f6fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:12.052864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f3326-c7ab-449a-94fd-7d57d9f6fabe None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.053376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f3326-c7ab-449a-94fd-7d57d9f6fabe None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.053856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f3326-c7ab-449a-94fd-7d57d9f6fabe None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.054813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f3326-c7ab-449a-94fd-7d57d9f6fabe None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:12.055225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f3326-c7ab-449a-94fd-7d57d9f6fabe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:12.056729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f3326-c7ab-449a-94fd-7d57d9f6fabe None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:12.057723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a984f1f-01c8-43cf-af4d-49c9d0dffab9 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:12.070119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 474/946] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:12.075820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f3326-c7ab-449a-94fd-7d57d9f6fabe None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:12.083052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:12.187236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a984f1f-01c8-43cf-af4d-49c9d0dffab9 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:12.195037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f3326-c7ab-449a-94fd-7d57d9f6fabe None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:12.231186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5064f3-c250-4f21-98df-993d56f10cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:12.231885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5064f3-c250-4f21-98df-993d56f10cd2 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.232174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5064f3-c250-4f21-98df-993d56f10cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.232508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5064f3-c250-4f21-98df-993d56f10cd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.233491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5064f3-c250-4f21-98df-993d56f10cd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:12.234750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efb9ff-1a71-47d0-a50e-eb85e8fc87ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:12.234956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5064f3-c250-4f21-98df-993d56f10cd2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:12.235987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efb9ff-1a71-47d0-a50e-eb85e8fc87ed None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.236477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efb9ff-1a71-47d0-a50e-eb85e8fc87ed None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.236964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efb9ff-1a71-47d0-a50e-eb85e8fc87ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.244403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efb9ff-1a71-47d0-a50e-eb85e8fc87ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:12.245977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efb9ff-1a71-47d0-a50e-eb85e8fc87ed None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-c0efb9ff-1a71-47d0-a50e-eb85e8fc87ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:21:12.260992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:12.261933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:12.262821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:21:12.262821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:21:12.262821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:21:12.262821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:21:12.262821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:21:12.262821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:21:12.262821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:12.262821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:12.266771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 475/947] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:12.267517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efb9ff-1a71-47d0-a50e-eb85e8fc87ed None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:12.285707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:12.319377 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 473/948] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 16 00:21:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:12.385482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efb9ff-1a71-47d0-a50e-eb85e8fc87ed None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:12.429997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8e956-0174-4ee4-94cd-7c3341095e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:12.430727 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8e956-0174-4ee4-94cd-7c3341095e2d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.431023 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8e956-0174-4ee4-94cd-7c3341095e2d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.431329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8e956-0174-4ee4-94cd-7c3341095e2d None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.432367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8e956-0174-4ee4-94cd-7c3341095e2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:12.432719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8e956-0174-4ee4-94cd-7c3341095e2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:12.434245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8e956-0174-4ee4-94cd-7c3341095e2d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:12.451153 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 476/949] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:12.454447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5064f3-c250-4f21-98df-993d56f10cd2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:12.531821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:12.563582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5064f3-c250-4f21-98df-993d56f10cd2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:12.599034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839710-98f9-4b0d-b484-2a16c5ad1c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:12.599944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839710-98f9-4b0d-b484-2a16c5ad1c14 None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.600224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839710-98f9-4b0d-b484-2a16c5ad1c14 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.600502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839710-98f9-4b0d-b484-2a16c5ad1c14 None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/32f11d0d46f94beba8913591371d5e33/roles/f67c45ce861841519313d6585e5bd3fe` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.602994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839710-98f9-4b0d-b484-2a16c5ad1c14 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=32f11d0d46f94beba8913591371d5e33, role_id=f67c45ce861841519313d6585e5bd3fe)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:12.604813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839710-98f9-4b0d-b484-2a16c5ad1c14 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:12.685934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 474/950] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:21:12 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/32f11d0d46f94beba8913591371d5e33/roles/f67c45ce861841519313d6585e5bd3fe => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:21:12.720439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a444d-39ce-4e1c-bde3-9c6fe5097599 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.720989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a444d-39ce-4e1c-bde3-9c6fe5097599 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.720989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a444d-39ce-4e1c-bde3-9c6fe5097599 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.722775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 477/951] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:12.728612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d0e6-f0fb-4362-9002-a90c8ea75699 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.728936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d0e6-f0fb-4362-9002-a90c8ea75699 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.729175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d0e6-f0fb-4362-9002-a90c8ea75699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.747699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-22a5d0e6-f0fb-4362-9002-a90c8ea75699 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:12.749003 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-22a5d0e6-f0fb-4362-9002-a90c8ea75699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:12.827452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 475/952] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:12.849368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a444d-39ce-4e1c-bde3-9c6fe5097599 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:12.927529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:12.960906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a444d-39ce-4e1c-bde3-9c6fe5097599 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:12.996259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd39429-98bb-4787-825e-ea89f33599b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:12.996921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39429-98bb-4787-825e-ea89f33599b0 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.997205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39429-98bb-4787-825e-ea89f33599b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.997481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39429-98bb-4787-825e-ea89f33599b0 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.998181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd39429-98bb-4787-825e-ea89f33599b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:12.999618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd39429-98bb-4787-825e-ea89f33599b0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:13.001018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WARNING keystone.server.flask.common [None req-7cd39429-98bb-4787-825e-ea89f33599b0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 00:21:13.055226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.sql.core [None req-7cd39429-98bb-4787-825e-ea89f33599b0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:21:13.055226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 00:21:13.055226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [parameters: {'id': 'b3ddd1229e3845d39dce082263b315c6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 00:21:13.055226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97111) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-7cd39429-98bb-4787-825e-ea89f33599b0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b3ddd1229e3845d39dce082263b315c6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b3ddd1229e3845d39dce082263b315c6. Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:21:13.071914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application result.read() Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 00:21:13.072826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application yield resource Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise self.value Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application session.commit() Jun 16 00:21:13.074804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:21:13.075703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:21:13.077105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application result.read() Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:21:13.079091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [parameters: {'id': 'b3ddd1229e3845d39dce082263b315c6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:13.082439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:13.084409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b3ddd1229e3845d39dce082263b315c6. Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.086841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 478/953] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Jun 16 00:21:12 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:13.094348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d0e6-f0fb-4362-9002-a90c8ea75699 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:13.161987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:13.175132 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac058c4-7c68-4f83-b54c-452767fc6c7b None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:13.175434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac058c4-7c68-4f83-b54c-452767fc6c7b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:13.175677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac058c4-7c68-4f83-b54c-452767fc6c7b None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:13.184423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 479/954] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:13.185717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98801e57-bd1a-433c-96fa-61707398a2c9 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:13.186006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98801e57-bd1a-433c-96fa-61707398a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:13.186281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98801e57-bd1a-433c-96fa-61707398a2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:13.202833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d0e6-f0fb-4362-9002-a90c8ea75699 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:13.208344 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-98801e57-bd1a-433c-96fa-61707398a2c9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:13.209957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-98801e57-bd1a-433c-96fa-61707398a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:13.241258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177b70f-9835-4211-bfb4-483bfc1591e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:13.242260 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177b70f-9835-4211-bfb4-483bfc1591e4 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:13.242538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177b70f-9835-4211-bfb4-483bfc1591e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:13.242816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177b70f-9835-4211-bfb4-483bfc1591e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:13.250934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177b70f-9835-4211-bfb4-483bfc1591e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:13.252433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177b70f-9835-4211-bfb4-483bfc1591e4 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-8177b70f-9835-4211-bfb4-483bfc1591e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:21:13.269435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:13.270466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:13.271379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:21:13.271379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:21:13.271379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:21:13.271379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:21:13.271379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:21:13.271379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:21:13.271379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:13.271379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:13.271379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 476/955] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:13.277748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177b70f-9835-4211-bfb4-483bfc1591e4 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:13.302785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 480/956] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:13.325595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98801e57-bd1a-433c-96fa-61707398a2c9 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:13.390494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177b70f-9835-4211-bfb4-483bfc1591e4 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:13.397090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:13.416335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:13.435857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc41b41-4ab5-450c-bed1-35399f0f42d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:13.437058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc41b41-4ab5-450c-bed1-35399f0f42d4 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:13.437502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc41b41-4ab5-450c-bed1-35399f0f42d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:13.437920 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc41b41-4ab5-450c-bed1-35399f0f42d4 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:13.439263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc41b41-4ab5-450c-bed1-35399f0f42d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:13.440030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc41b41-4ab5-450c-bed1-35399f0f42d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:13.442076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc41b41-4ab5-450c-bed1-35399f0f42d4 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:13.447472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98801e57-bd1a-433c-96fa-61707398a2c9 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:13.471790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 477/957] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:21:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:13.489426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a33e72-980e-4304-b4cb-b390dc66fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:13.490257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a33e72-980e-4304-b4cb-b390dc66fae5 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:13.490762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a33e72-980e-4304-b4cb-b390dc66fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:13.491039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a33e72-980e-4304-b4cb-b390dc66fae5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:13.491702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a33e72-980e-4304-b4cb-b390dc66fae5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:13.493299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a33e72-980e-4304-b4cb-b390dc66fae5 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-27a33e72-980e-4304-b4cb-b390dc66fae5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:13.510550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:13.512359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:13.513279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 481/958] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:13.520376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc41b41-4ab5-450c-bed1-35399f0f42d4 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:13.641248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc41b41-4ab5-450c-bed1-35399f0f42d4 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:13.674967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e55c4-6b79-4344-a6de-9e112dd7c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:13.675632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e55c4-6b79-4344-a6de-9e112dd7c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:13.675945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e55c4-6b79-4344-a6de-9e112dd7c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:13.676221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e55c4-6b79-4344-a6de-9e112dd7c0f3 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:13.676920 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e55c4-6b79-4344-a6de-9e112dd7c0f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:13.677226 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e55c4-6b79-4344-a6de-9e112dd7c0f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:13.678627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e55c4-6b79-4344-a6de-9e112dd7c0f3 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:13.685065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 478/959] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:21:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:13.692822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a33e72-980e-4304-b4cb-b390dc66fae5 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:13.800878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a33e72-980e-4304-b4cb-b390dc66fae5 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:13.822641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:13.838371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1b5ec-30e4-4f21-9454-cc06fb265ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:13.839064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1b5ec-30e4-4f21-9454-cc06fb265ddb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:13.839343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1b5ec-30e4-4f21-9454-cc06fb265ddb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:13.839619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1b5ec-30e4-4f21-9454-cc06fb265ddb None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:13.840357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1b5ec-30e4-4f21-9454-cc06fb265ddb None admin] RBAC: Adding query filter params (type=compute) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:13.840660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1b5ec-30e4-4f21-9454-cc06fb265ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:13.842088 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1b5ec-30e4-4f21-9454-cc06fb265ddb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:13.851886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 482/960] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:21:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:14.655862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a5cf-376b-46ca-9c4a-52b6d402ac91 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:14.656385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a5cf-376b-46ca-9c4a-52b6d402ac91 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:14.656385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a5cf-376b-46ca-9c4a-52b6d402ac91 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:14.658052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 479/961] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:14.663416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1f93e-751e-49e7-a15c-7e35b92b3794 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:14.663709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1f93e-751e-49e7-a15c-7e35b92b3794 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:14.664021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1f93e-751e-49e7-a15c-7e35b92b3794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:14.680668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-44c1f93e-751e-49e7-a15c-7e35b92b3794 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:14.681875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-44c1f93e-751e-49e7-a15c-7e35b92b3794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:14.758112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 483/962] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:14.781177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a5cf-376b-46ca-9c4a-52b6d402ac91 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:14.835880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:14.884843 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cd6e0-f6b1-48c1-9420-415baf380e98 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:14.885356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cd6e0-f6b1-48c1-9420-415baf380e98 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:14.885469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cd6e0-f6b1-48c1-9420-415baf380e98 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:14.887479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 484/963] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:14.892288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7f432-81d3-4827-a413-c779009c5de9 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:14.892580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7f432-81d3-4827-a413-c779009c5de9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:14.892859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7f432-81d3-4827-a413-c779009c5de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:14.895543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a5cf-376b-46ca-9c4a-52b6d402ac91 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:14.909979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-aff7f432-81d3-4827-a413-c779009c5de9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:14.911073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-aff7f432-81d3-4827-a413-c779009c5de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:14.937393 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca735c6b-732c-42d0-b879-385e0ae30d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:14.938323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca735c6b-732c-42d0-b879-385e0ae30d94 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:14.938785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca735c6b-732c-42d0-b879-385e0ae30d94 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:14.939160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca735c6b-732c-42d0-b879-385e0ae30d94 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:14.939989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca735c6b-732c-42d0-b879-385e0ae30d94 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:14.941584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca735c6b-732c-42d0-b879-385e0ae30d94 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-ca735c6b-732c-42d0-b879-385e0ae30d94 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:14.955763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:14.956962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:14.957810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:14.958554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 480/964] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:14.964970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca735c6b-732c-42d0-b879-385e0ae30d94 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:14.995842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 485/965] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:15.026763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7f432-81d3-4827-a413-c779009c5de9 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:15.083997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca735c6b-732c-42d0-b879-385e0ae30d94 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:15.092879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:15.096158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:15.124284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb24c60-c87b-410f-9392-4d6719f9e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:15.125048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb24c60-c87b-410f-9392-4d6719f9e6fa None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.125408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb24c60-c87b-410f-9392-4d6719f9e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.125758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb24c60-c87b-410f-9392-4d6719f9e6fa None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.126546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb24c60-c87b-410f-9392-4d6719f9e6fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:15.126920 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb24c60-c87b-410f-9392-4d6719f9e6fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:15.128887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb24c60-c87b-410f-9392-4d6719f9e6fa None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:15.135574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 481/966] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:15.141491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb24c60-c87b-410f-9392-4d6719f9e6fa None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:15.160705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7f432-81d3-4827-a413-c779009c5de9 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:15.203192 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa743c0-d3e6-466a-aeb8-0bda0c1c3042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:15.204579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa743c0-d3e6-466a-aeb8-0bda0c1c3042 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.205005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa743c0-d3e6-466a-aeb8-0bda0c1c3042 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.205438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa743c0-d3e6-466a-aeb8-0bda0c1c3042 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.218398 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa743c0-d3e6-466a-aeb8-0bda0c1c3042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-8fa743c0-d3e6-466a-aeb8-0bda0c1c3042 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:15.228234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:15.229445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:15.230488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:15.233437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 486/967] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 16 00:21:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:15.238802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa743c0-d3e6-466a-aeb8-0bda0c1c3042 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:15.268395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb24c60-c87b-410f-9392-4d6719f9e6fa None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:15.316142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e4ac4-6931-4401-8d7d-1356aa6359ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:15.316911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4ac4-6931-4401-8d7d-1356aa6359ec None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.317264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4ac4-6931-4401-8d7d-1356aa6359ec None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.318020 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4ac4-6931-4401-8d7d-1356aa6359ec None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.318456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e4ac4-6931-4401-8d7d-1356aa6359ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:15.318832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e4ac4-6931-4401-8d7d-1356aa6359ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:15.320334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e4ac4-6931-4401-8d7d-1356aa6359ec None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:15.331032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 482/968] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:15.332096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e4ac4-6931-4401-8d7d-1356aa6359ec None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:15.353531 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa743c0-d3e6-466a-aeb8-0bda0c1c3042 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:15.356767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:15.378153 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:15.389736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb751b-b9c7-436e-b85b-3d41d3e6e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:15.390543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb751b-b9c7-436e-b85b-3d41d3e6e415 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.390930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb751b-b9c7-436e-b85b-3d41d3e6e415 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.391427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb751b-b9c7-436e-b85b-3d41d3e6e415 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.392194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb751b-b9c7-436e-b85b-3d41d3e6e415 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:15.392855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb751b-b9c7-436e-b85b-3d41d3e6e415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:15.394865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb751b-b9c7-436e-b85b-3d41d3e6e415 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:15.403765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 487/969] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 16 00:21:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:15.409326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb751b-b9c7-436e-b85b-3d41d3e6e415 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:15.458473 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e4ac4-6931-4401-8d7d-1356aa6359ec None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:15.504357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ada32-13ac-4598-b1be-d63d291d4298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:15.505451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ada32-13ac-4598-b1be-d63d291d4298 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.505935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ada32-13ac-4598-b1be-d63d291d4298 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.506389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ada32-13ac-4598-b1be-d63d291d4298 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.507722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ada32-13ac-4598-b1be-d63d291d4298 None admin] RBAC: Adding query filter params (interface=admin, service_id=145914dd878a4d16ac5ca94c45fa462b, region_id=RegionOne) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:15.508243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ada32-13ac-4598-b1be-d63d291d4298 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:15.509966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ada32-13ac-4598-b1be-d63d291d4298 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:15.520099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 483/970] 10.222.0.27 () {56 vars in 1249 bytes} [Thu Jun 16 00:21:15 2022] GET /identity/v3/endpoints?service_id=145914dd878a4d16ac5ca94c45fa462b&interface=admin®ion_id=RegionOne => generated 193 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:15.522277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ada32-13ac-4598-b1be-d63d291d4298 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:15.533784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb751b-b9c7-436e-b85b-3d41d3e6e415 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:15.570541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce779994-f1e4-404d-8011-603e55794beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:15.571457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779994-f1e4-404d-8011-603e55794beb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.571773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779994-f1e4-404d-8011-603e55794beb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.572068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779994-f1e4-404d-8011-603e55794beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.583685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce779994-f1e4-404d-8011-603e55794beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:15.585317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce779994-f1e4-404d-8011-603e55794beb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-ce779994-f1e4-404d-8011-603e55794beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:15.603611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:15.605252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:15.606131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:15.606131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:15.606131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:15.606131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:15.610311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 488/971] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:15.611456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce779994-f1e4-404d-8011-603e55794beb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:15.634667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ada32-13ac-4598-b1be-d63d291d4298 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:15.636230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:15.637319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:15.671421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a62e-ac65-4d17-9c34-75187d650801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:15.672971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a62e-ac65-4d17-9c34-75187d650801 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.673470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a62e-ac65-4d17-9c34-75187d650801 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.673969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a62e-ac65-4d17-9c34-75187d650801 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.674852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5a62e-ac65-4d17-9c34-75187d650801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:15.676599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5a62e-ac65-4d17-9c34-75187d650801 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:15.688016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 484/972] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 16 00:21:15 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:21:15.722234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce779994-f1e4-404d-8011-603e55794beb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:15.766766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572cde8-bb3e-46fc-94fe-9715462c0006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:15.767460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572cde8-bb3e-46fc-94fe-9715462c0006 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.767766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572cde8-bb3e-46fc-94fe-9715462c0006 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.768067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572cde8-bb3e-46fc-94fe-9715462c0006 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.768972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572cde8-bb3e-46fc-94fe-9715462c0006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:15.769288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572cde8-bb3e-46fc-94fe-9715462c0006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:15.770716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572cde8-bb3e-46fc-94fe-9715462c0006 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:15.785641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 489/973] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:15.791311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a62e-ac65-4d17-9c34-75187d650801 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:15.815778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9455fc9-3d92-46e9-a12d-70620ad8a122 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.816131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9455fc9-3d92-46e9-a12d-70620ad8a122 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.816332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9455fc9-3d92-46e9-a12d-70620ad8a122 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.817878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 490/974] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:15.824276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bab133-8aaf-4501-a615-299bb6eef4bc None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.824577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bab133-8aaf-4501-a615-299bb6eef4bc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.824823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bab133-8aaf-4501-a615-299bb6eef4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.846749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b8bab133-8aaf-4501-a615-299bb6eef4bc None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:15.848449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b8bab133-8aaf-4501-a615-299bb6eef4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:15.919675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a62e-ac65-4d17-9c34-75187d650801 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:15.931644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 491/975] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:15.956058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bab133-8aaf-4501-a615-299bb6eef4bc None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:15.962796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02458b61-2137-4682-8768-32f2e5268e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:15.963629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02458b61-2137-4682-8768-32f2e5268e47 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.964479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02458b61-2137-4682-8768-32f2e5268e47 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.964757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02458b61-2137-4682-8768-32f2e5268e47 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.973163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02458b61-2137-4682-8768-32f2e5268e47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:15.974944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02458b61-2137-4682-8768-32f2e5268e47 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-02458b61-2137-4682-8768-32f2e5268e47 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:21:15.991397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:15.992594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:21:15.993556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:15.994118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:15.994191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 485/976] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:21:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:16.000464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02458b61-2137-4682-8768-32f2e5268e47 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:16.042495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:16.081987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bab133-8aaf-4501-a615-299bb6eef4bc None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:16.117997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:16.118759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.119049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.119349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.120143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:16.120370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02458b61-2137-4682-8768-32f2e5268e47 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:16.121585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:16.154986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2376a-9cd9-4f7a-a7d2-9589fbd47b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:16.155656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2376a-9cd9-4f7a-a7d2-9589fbd47b0c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.155996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2376a-9cd9-4f7a-a7d2-9589fbd47b0c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.156279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2376a-9cd9-4f7a-a7d2-9589fbd47b0c None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.157114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2376a-9cd9-4f7a-a7d2-9589fbd47b0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:16.157427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2376a-9cd9-4f7a-a7d2-9589fbd47b0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:16.158869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2376a-9cd9-4f7a-a7d2-9589fbd47b0c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:16.169054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.sql.core [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:21:16.169054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 00:21:16.169054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [parameters: {'user_id': '6eeca50eda3d4e56bcf07a4996413831', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 00:21:16.169054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97111) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application result.read() Jun 16 00:21:16.176435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:21:16.177405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application yield resource Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise self.value Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application session.commit() Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:21:16.178551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:21:16.179621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:21:16.180989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application result.read() Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:21:16.182322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [parameters: {'user_id': '6eeca50eda3d4e56bcf07a4996413831', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:16.183413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 00:21:16.188660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 00:21:16.189543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 00:21:16.189543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 00:21:16.189543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:21:16.189543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:21:16.189543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 00:21:16.189543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:16.189866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 486/977] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 16 00:21:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:16.189940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 492/978] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 16 00:21:15 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:16.190006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23a1ba-f721-45d1-8929-167a3691919e None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.190006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23a1ba-f721-45d1-8929-167a3691919e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.190006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23a1ba-f721-45d1-8929-167a3691919e None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.190195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:16.190270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 487/979] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:16.191777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95305-146b-4e00-99dd-5467b79ae0b0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.192076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95305-146b-4e00-99dd-5467b79ae0b0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.192358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95305-146b-4e00-99dd-5467b79ae0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.210443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-dee95305-146b-4e00-99dd-5467b79ae0b0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:16.211634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dee95305-146b-4e00-99dd-5467b79ae0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:16.268830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:16.286806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 488/980] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:16.287984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee95305-146b-4e00-99dd-5467b79ae0b0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:16.306555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cfe7e-fdcb-4a10-8a07-b0826ebc26b0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:16.309233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:16.345403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1b023-d6e2-4ee9-b78e-6050b3ae6d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:16.346043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1b023-d6e2-4ee9-b78e-6050b3ae6d0b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.346321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1b023-d6e2-4ee9-b78e-6050b3ae6d0b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.346592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1b023-d6e2-4ee9-b78e-6050b3ae6d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.398000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee95305-146b-4e00-99dd-5467b79ae0b0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:16.421532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1b023-d6e2-4ee9-b78e-6050b3ae6d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:16.423271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1b023-d6e2-4ee9-b78e-6050b3ae6d0b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:16.433085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e7f49-718d-4245-8e44-f269706f7f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:16.434001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e7f49-718d-4245-8e44-f269706f7f31 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.434362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e7f49-718d-4245-8e44-f269706f7f31 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.434712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e7f49-718d-4245-8e44-f269706f7f31 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.442484 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e7f49-718d-4245-8e44-f269706f7f31 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:16.444052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e7f49-718d-4245-8e44-f269706f7f31 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-8d3e7f49-718d-4245-8e44-f269706f7f31 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:21:16.459396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:16.460543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:16.461740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 489/981] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:21:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:16.462348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e7f49-718d-4245-8e44-f269706f7f31 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:16.498046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:16.530508 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 493/982] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:16 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:16.531185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1b023-d6e2-4ee9-b78e-6050b3ae6d0b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:16.545850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:16.570299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e7f49-718d-4245-8e44-f269706f7f31 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:16.606739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e15429-8e74-40fc-bd96-157a9ff1fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:16.607403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e15429-8e74-40fc-bd96-157a9ff1fc81 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.607691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e15429-8e74-40fc-bd96-157a9ff1fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.608001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e15429-8e74-40fc-bd96-157a9ff1fc81 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.609118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e15429-8e74-40fc-bd96-157a9ff1fc81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:16.610864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e15429-8e74-40fc-bd96-157a9ff1fc81 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:16.632942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1b023-d6e2-4ee9-b78e-6050b3ae6d0b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:16.666960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 490/983] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:21:16 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:16.668085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e15429-8e74-40fc-bd96-157a9ff1fc81 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:16.678520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d082234-c16e-4b97-a67c-96fcaaebb292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:16.679250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082234-c16e-4b97-a67c-96fcaaebb292 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.679782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082234-c16e-4b97-a67c-96fcaaebb292 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.680080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082234-c16e-4b97-a67c-96fcaaebb292 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.681903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d082234-c16e-4b97-a67c-96fcaaebb292 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:16.682242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d082234-c16e-4b97-a67c-96fcaaebb292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:16.684310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d082234-c16e-4b97-a67c-96fcaaebb292 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:16.739782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 494/984] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 16 00:21:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:16.809998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e15429-8e74-40fc-bd96-157a9ff1fc81 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:16.849653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c46046-aa3e-4e48-b47a-7c7ebe8e1a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:16.850564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c46046-aa3e-4e48-b47a-7c7ebe8e1a76 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.850853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c46046-aa3e-4e48-b47a-7c7ebe8e1a76 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.851133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c46046-aa3e-4e48-b47a-7c7ebe8e1a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.853463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:16.863998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c46046-aa3e-4e48-b47a-7c7ebe8e1a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:16.865510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c46046-aa3e-4e48-b47a-7c7ebe8e1a76 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-69c46046-aa3e-4e48-b47a-7c7ebe8e1a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:16.885433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:16.886439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:16.887379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:16.887379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:16.887379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:16.887379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:16.887379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 491/985] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:16.892815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d082234-c16e-4b97-a67c-96fcaaebb292 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:16.929033 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:17.005584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d082234-c16e-4b97-a67c-96fcaaebb292 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:17.043238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da775e-e224-47a7-92e0-9f2a698e8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:17.043953 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da775e-e224-47a7-92e0-9f2a698e8db3 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:17.044245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da775e-e224-47a7-92e0-9f2a698e8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:17.044522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da775e-e224-47a7-92e0-9f2a698e8db3 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:17.045246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da775e-e224-47a7-92e0-9f2a698e8db3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:17.045560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da775e-e224-47a7-92e0-9f2a698e8db3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:17.046938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da775e-e224-47a7-92e0-9f2a698e8db3 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:17.059716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 495/986] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:17.065022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c46046-aa3e-4e48-b47a-7c7ebe8e1a76 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:17.166043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c46046-aa3e-4e48-b47a-7c7ebe8e1a76 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:17.199380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d3ea-b7df-4d83-8fc1-f06282439aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:17.200337 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d3ea-b7df-4d83-8fc1-f06282439aa0 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:17.200726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d3ea-b7df-4d83-8fc1-f06282439aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:17.201106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d3ea-b7df-4d83-8fc1-f06282439aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:17.207832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777d3ea-b7df-4d83-8fc1-f06282439aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:17.209384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777d3ea-b7df-4d83-8fc1-f06282439aa0 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-1777d3ea-b7df-4d83-8fc1-f06282439aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:21:17.225801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:17.226915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:17.228047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:21:17.228047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:21:17.228047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:21:17.228047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:21:17.228047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:21:17.228047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:21:17.228047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:17.228047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:17.233897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 492/987] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:17.235229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da775e-e224-47a7-92e0-9f2a698e8db3 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:17.319539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:17.335257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da775e-e224-47a7-92e0-9f2a698e8db3 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:17.369426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbbb5f-7f74-4876-b7f1-700f82c0f802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:17.370121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbbb5f-7f74-4876-b7f1-700f82c0f802 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:17.370405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbbb5f-7f74-4876-b7f1-700f82c0f802 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:17.370684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbbb5f-7f74-4876-b7f1-700f82c0f802 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:17.371461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbbb5f-7f74-4876-b7f1-700f82c0f802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:17.371798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbbb5f-7f74-4876-b7f1-700f82c0f802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:17.373371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbbb5f-7f74-4876-b7f1-700f82c0f802 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:17.390492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 496/988] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:21:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:17.391644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d3ea-b7df-4d83-8fc1-f06282439aa0 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:17.440898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:17.494941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d3ea-b7df-4d83-8fc1-f06282439aa0 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:17.530530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce7871-e970-442d-ae46-ff9425178e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:17.531200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce7871-e970-442d-ae46-ff9425178e40 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:17.531488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce7871-e970-442d-ae46-ff9425178e40 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:17.531791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce7871-e970-442d-ae46-ff9425178e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:17.532627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce7871-e970-442d-ae46-ff9425178e40 None admin] RBAC: Adding query filter params (role.id=f67c45ce861841519313d6585e5bd3fe, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=32f11d0d46f94beba8913591371d5e33) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:17.532944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce7871-e970-442d-ae46-ff9425178e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:17.534388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce7871-e970-442d-ae46-ff9425178e40 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:17.540767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 493/989] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:17 2022] GET /identity/v3/role_assignments?user.id=32f11d0d46f94beba8913591371d5e33&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=f67c45ce861841519313d6585e5bd3fe => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:17.900030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82592-3cf9-476d-8295-f9d6c00df3f5 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:17.900414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82592-3cf9-476d-8295-f9d6c00df3f5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:17.900593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82592-3cf9-476d-8295-f9d6c00df3f5 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:17.902769 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 497/990] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:17.907837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808192-264a-4afa-ab0b-06cae7faf2aa None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:17.908267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808192-264a-4afa-ab0b-06cae7faf2aa None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:17.908426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808192-264a-4afa-ab0b-06cae7faf2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:17.925158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-81808192-264a-4afa-ab0b-06cae7faf2aa None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:17.926328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-81808192-264a-4afa-ab0b-06cae7faf2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:17.995775 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 494/991] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:18.017798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82592-3cf9-476d-8295-f9d6c00df3f5 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:18.136524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82592-3cf9-476d-8295-f9d6c00df3f5 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:18.169281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7a9a3-6aff-4eac-a7e6-f691642a71f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:18.170021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7a9a3-6aff-4eac-a7e6-f691642a71f4 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:18.170308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7a9a3-6aff-4eac-a7e6-f691642a71f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:18.170644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7a9a3-6aff-4eac-a7e6-f691642a71f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:18.171288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7a9a3-6aff-4eac-a7e6-f691642a71f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:18.172744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7a9a3-6aff-4eac-a7e6-f691642a71f4 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e8a7a9a3-6aff-4eac-a7e6-f691642a71f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:18.185189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:18.186126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:18.186976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 498/992] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 16 00:21:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:18.192192 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81808192-264a-4afa-ab0b-06cae7faf2aa None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:18.235098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:18.295994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81808192-264a-4afa-ab0b-06cae7faf2aa None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:18.333050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7689e-2722-4fb9-9ff8-b22a99b9605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:18.333714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7689e-2722-4fb9-9ff8-b22a99b9605c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:18.333994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7689e-2722-4fb9-9ff8-b22a99b9605c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:18.334263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7689e-2722-4fb9-9ff8-b22a99b9605c None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:18.334959 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7689e-2722-4fb9-9ff8-b22a99b9605c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:18.335262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7689e-2722-4fb9-9ff8-b22a99b9605c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:18.336678 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7689e-2722-4fb9-9ff8-b22a99b9605c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:18.346393 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 495/993] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:18.347339 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7a9a3-6aff-4eac-a7e6-f691642a71f4 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:18.359192 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:18.447783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7a9a3-6aff-4eac-a7e6-f691642a71f4 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:18.479979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777818ba-ae47-42a9-b271-f289563b972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:18.480638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777818ba-ae47-42a9-b271-f289563b972c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:18.480919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777818ba-ae47-42a9-b271-f289563b972c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:18.481191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777818ba-ae47-42a9-b271-f289563b972c None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:18.481883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777818ba-ae47-42a9-b271-f289563b972c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:18.482189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777818ba-ae47-42a9-b271-f289563b972c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:18.483543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777818ba-ae47-42a9-b271-f289563b972c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:18.493494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 499/994] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 16 00:21:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:18.494597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7689e-2722-4fb9-9ff8-b22a99b9605c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:18.592889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7689e-2722-4fb9-9ff8-b22a99b9605c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:18.595218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:18.626841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e04278-9da5-4f04-aff8-f3cc847a5685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:18.627483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04278-9da5-4f04-aff8-f3cc847a5685 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:18.627783 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04278-9da5-4f04-aff8-f3cc847a5685 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:18.628064 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04278-9da5-4f04-aff8-f3cc847a5685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:18.628795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e04278-9da5-4f04-aff8-f3cc847a5685 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:18.630166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e04278-9da5-4f04-aff8-f3cc847a5685 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:18.707577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 496/995] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 16 00:21:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:18.867127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af473-3105-40fa-afc9-46dedb621287 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:18.867415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af473-3105-40fa-afc9-46dedb621287 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:18.867695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2af473-3105-40fa-afc9-46dedb621287 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:18.869240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 500/996] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:18.874542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ee072-487e-4782-b955-3b64c46de7e1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:18.874837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ee072-487e-4782-b955-3b64c46de7e1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:18.875115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ee072-487e-4782-b955-3b64c46de7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:18.892273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-318ee072-487e-4782-b955-3b64c46de7e1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:18.893438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-318ee072-487e-4782-b955-3b64c46de7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:18.970648 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 497/997] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:18.993012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2af473-3105-40fa-afc9-46dedb621287 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:19.070812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:19.101541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2af473-3105-40fa-afc9-46dedb621287 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:19.134947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86933976-500b-41d4-a428-7b2b2ccac317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:19.136289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86933976-500b-41d4-a428-7b2b2ccac317 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.136570 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86933976-500b-41d4-a428-7b2b2ccac317 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.136840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86933976-500b-41d4-a428-7b2b2ccac317 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.137482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86933976-500b-41d4-a428-7b2b2ccac317 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:19.138831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86933976-500b-41d4-a428-7b2b2ccac317 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-86933976-500b-41d4-a428-7b2b2ccac317 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:19.150374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:19.152249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:21:19.153116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:19.155812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 501/998] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:19.158369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ee072-487e-4782-b955-3b64c46de7e1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:19.250785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:19.261485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ee072-487e-4782-b955-3b64c46de7e1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:19.296960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49669b-2bf4-454b-bb2d-0e712cad6482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:19.297625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49669b-2bf4-454b-bb2d-0e712cad6482 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.297905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49669b-2bf4-454b-bb2d-0e712cad6482 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.298179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49669b-2bf4-454b-bb2d-0e712cad6482 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.298873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49669b-2bf4-454b-bb2d-0e712cad6482 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:19.299178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49669b-2bf4-454b-bb2d-0e712cad6482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:19.300570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49669b-2bf4-454b-bb2d-0e712cad6482 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:19.305745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 498/999] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:21:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:19.311313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86933976-500b-41d4-a428-7b2b2ccac317 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:19.412006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86933976-500b-41d4-a428-7b2b2ccac317 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:19.445038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e639b-8a7a-403b-b16f-03a4f11c8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:19.445700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e639b-8a7a-403b-b16f-03a4f11c8694 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.445980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e639b-8a7a-403b-b16f-03a4f11c8694 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.446254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e639b-8a7a-403b-b16f-03a4f11c8694 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.446949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e639b-8a7a-403b-b16f-03a4f11c8694 None admin] RBAC: Adding query filter params (type=compute) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:19.447250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e639b-8a7a-403b-b16f-03a4f11c8694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:19.449200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e639b-8a7a-403b-b16f-03a4f11c8694 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:19.451195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:19.455025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 502/1000] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:21:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:19.460849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49669b-2bf4-454b-bb2d-0e712cad6482 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:19.560031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49669b-2bf4-454b-bb2d-0e712cad6482 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:19.593551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77b027-cc76-425a-b08f-e5443d3dec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:19.594197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b027-cc76-425a-b08f-e5443d3dec63 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.594483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b027-cc76-425a-b08f-e5443d3dec63 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.594755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b027-cc76-425a-b08f-e5443d3dec63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.595529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77b027-cc76-425a-b08f-e5443d3dec63 None admin] RBAC: Adding query filter params (interface=public, service_id=273f38241e2c45d1a3d9c61d704d3cb3, region_id=RegionOne) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:19.595867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77b027-cc76-425a-b08f-e5443d3dec63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:19.597233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77b027-cc76-425a-b08f-e5443d3dec63 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:19.602325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 499/1001] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 16 00:21:19 2022] GET /identity/v3/endpoints?service_id=273f38241e2c45d1a3d9c61d704d3cb3&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:19.607790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e639b-8a7a-403b-b16f-03a4f11c8694 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:19.699557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ae542-41c4-46bd-9675-307ea5b5d11e None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.699900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ae542-41c4-46bd-9675-307ea5b5d11e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.700163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ae542-41c4-46bd-9675-307ea5b5d11e None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.701516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 500/1002] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:19.706200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff3643-ab1f-4720-9f8b-3edcc4fa3ea7 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.706493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff3643-ab1f-4720-9f8b-3edcc4fa3ea7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.706772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff3643-ab1f-4720-9f8b-3edcc4fa3ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.712309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e639b-8a7a-403b-b16f-03a4f11c8694 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:19.723259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-13ff3643-ab1f-4720-9f8b-3edcc4fa3ea7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:19.724556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-13ff3643-ab1f-4720-9f8b-3edcc4fa3ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:19.737743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:19.747954 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf346a-6449-4691-8034-176d8b170386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:19.748614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf346a-6449-4691-8034-176d8b170386 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.748894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf346a-6449-4691-8034-176d8b170386 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.758822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf346a-6449-4691-8034-176d8b170386 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.758822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf346a-6449-4691-8034-176d8b170386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:19.758822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf346a-6449-4691-8034-176d8b170386 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:19.758822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 503/1003] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 16 00:21:19 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:21:19.811878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 501/1004] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:19.831093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf346a-6449-4691-8034-176d8b170386 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:19.902627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:19.943452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf346a-6449-4691-8034-176d8b170386 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:19.978812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd3277-8a41-44cf-95a2-d8f344f50903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:19.979628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd3277-8a41-44cf-95a2-d8f344f50903 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.979927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd3277-8a41-44cf-95a2-d8f344f50903 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.980198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd3277-8a41-44cf-95a2-d8f344f50903 None admin] PATH_INFO: `/v3/services/image` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.980836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd3277-8a41-44cf-95a2-d8f344f50903 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:19.982182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd3277-8a41-44cf-95a2-d8f344f50903 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-effd3277-8a41-44cf-95a2-d8f344f50903 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:19.993618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:19.994593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:19.995502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 504/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Jun 16 00:21:19 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:20.000863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff3643-ab1f-4720-9f8b-3edcc4fa3ea7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:20.104859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff3643-ab1f-4720-9f8b-3edcc4fa3ea7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:20.138518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855b219-fa5c-4b81-88a0-07450a419120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:20.139178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855b219-fa5c-4b81-88a0-07450a419120 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:20.139458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855b219-fa5c-4b81-88a0-07450a419120 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:20.139746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855b219-fa5c-4b81-88a0-07450a419120 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:20.140448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855b219-fa5c-4b81-88a0-07450a419120 None admin] RBAC: Adding query filter params (name=image) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:20.140753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855b219-fa5c-4b81-88a0-07450a419120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:20.142127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855b219-fa5c-4b81-88a0-07450a419120 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:20.147055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 502/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:20.152987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd3277-8a41-44cf-95a2-d8f344f50903 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:20.250611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd3277-8a41-44cf-95a2-d8f344f50903 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:20.276647 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:20.284705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a9b30-5d80-4c93-889e-fa4d8621a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:20.285365 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a9b30-5d80-4c93-889e-fa4d8621a167 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:20.285648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a9b30-5d80-4c93-889e-fa4d8621a167 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:20.286827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a9b30-5d80-4c93-889e-fa4d8621a167 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:20.286827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a9b30-5d80-4c93-889e-fa4d8621a167 None admin] RBAC: Adding query filter params (type=image) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:20.286988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a9b30-5d80-4c93-889e-fa4d8621a167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:20.288283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a9b30-5d80-4c93-889e-fa4d8621a167 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:20.292864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 505/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:20.874469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e1711-b784-4253-9bef-7c43cf8b3709 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:20.874849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e1711-b784-4253-9bef-7c43cf8b3709 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:20.875050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e1711-b784-4253-9bef-7c43cf8b3709 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:20.876581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 503/1008] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:20.882045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b249d-3825-4e5d-bc5c-23a2b25d55af None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:20.882338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b249d-3825-4e5d-bc5c-23a2b25d55af None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:20.882614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b249d-3825-4e5d-bc5c-23a2b25d55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:20.899200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-dc3b249d-3825-4e5d-bc5c-23a2b25d55af None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:20.900723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-dc3b249d-3825-4e5d-bc5c-23a2b25d55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:20.969959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 506/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:20.993038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e1711-b784-4253-9bef-7c43cf8b3709 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:21.008123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:21.101179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e1711-b784-4253-9bef-7c43cf8b3709 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:21.134545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3505d-9121-45d0-9196-dec745551408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:21.135267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3505d-9121-45d0-9196-dec745551408 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:21.135581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3505d-9121-45d0-9196-dec745551408 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:21.135889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3505d-9121-45d0-9196-dec745551408 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:21.137051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3505d-9121-45d0-9196-dec745551408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:21.138487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3505d-9121-45d0-9196-dec745551408 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:21.140261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 504/1010] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:21.145742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b249d-3825-4e5d-bc5c-23a2b25d55af None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:21.241786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b249d-3825-4e5d-bc5c-23a2b25d55af None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:21.263686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:21.275175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd09d8-6bec-4219-b174-96175a37f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:21.277218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd09d8-6bec-4219-b174-96175a37f7fd None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:21.277218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd09d8-6bec-4219-b174-96175a37f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:21.277218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd09d8-6bec-4219-b174-96175a37f7fd None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:21.277621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd09d8-6bec-4219-b174-96175a37f7fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:21.279044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd09d8-6bec-4219-b174-96175a37f7fd None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:21.353593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 507/1011] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:21:21 2022] POST /identity/v3/projects => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:21.904773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3567-e7bd-4bf5-a794-96c64fa14c6f None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:21.905170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3567-e7bd-4bf5-a794-96c64fa14c6f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:21.905344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3567-e7bd-4bf5-a794-96c64fa14c6f None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:21.906832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 505/1012] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:21.911897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9fc9-b3e6-4846-83c6-3922e865775e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:21.912190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9fc9-b3e6-4846-83c6-3922e865775e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:21.912465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9fc9-b3e6-4846-83c6-3922e865775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:21.928989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-296e9fc9-b3e6-4846-83c6-3922e865775e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:21.930161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-296e9fc9-b3e6-4846-83c6-3922e865775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:21.995995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 508/1013] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:22.018919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af3567-e7bd-4bf5-a794-96c64fa14c6f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:22.109250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:22.128713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af3567-e7bd-4bf5-a794-96c64fa14c6f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:22.163861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e01a49-0ee1-4134-ba19-6f99100a9bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:22.164573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e01a49-0ee1-4134-ba19-6f99100a9bb3 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.164852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e01a49-0ee1-4134-ba19-6f99100a9bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.165127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e01a49-0ee1-4134-ba19-6f99100a9bb3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.165770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e01a49-0ee1-4134-ba19-6f99100a9bb3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:22.167657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e01a49-0ee1-4134-ba19-6f99100a9bb3 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-e0e01a49-0ee1-4134-ba19-6f99100a9bb3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:22.179191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:22.180209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:22.186553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 506/1014] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:22.188997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e9fc9-b3e6-4846-83c6-3922e865775e None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:22.288269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e9fc9-b3e6-4846-83c6-3922e865775e None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:22.290558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:22.323337 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43740-d7af-4703-bfa4-26d27832df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:22.324034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43740-d7af-4703-bfa4-26d27832df35 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.324316 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43740-d7af-4703-bfa4-26d27832df35 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.324588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43740-d7af-4703-bfa4-26d27832df35 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.325279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43740-d7af-4703-bfa4-26d27832df35 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:22.325584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43740-d7af-4703-bfa4-26d27832df35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:22.326937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43740-d7af-4703-bfa4-26d27832df35 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:22.331693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 509/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:21:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:22.337335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e01a49-0ee1-4134-ba19-6f99100a9bb3 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:22.421333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d130fa3-9616-449c-89d0-2983414a3296 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.421627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d130fa3-9616-449c-89d0-2983414a3296 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.421815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d130fa3-9616-449c-89d0-2983414a3296 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.423357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 510/1016] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:22.427930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea04bd7-e919-4e65-bc7e-817c239725bf None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.428228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea04bd7-e919-4e65-bc7e-817c239725bf None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.428521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea04bd7-e919-4e65-bc7e-817c239725bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.445150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7ea04bd7-e919-4e65-bc7e-817c239725bf None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:22.446451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7ea04bd7-e919-4e65-bc7e-817c239725bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:22.449276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e01a49-0ee1-4134-ba19-6f99100a9bb3 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:22.486221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8335d7d-c558-4379-beef-01f0b123b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:22.486886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8335d7d-c558-4379-beef-01f0b123b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.487168 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8335d7d-c558-4379-beef-01f0b123b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.487444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8335d7d-c558-4379-beef-01f0b123b9b1 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.488174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8335d7d-c558-4379-beef-01f0b123b9b1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:22.488482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8335d7d-c558-4379-beef-01f0b123b9b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:22.490235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8335d7d-c558-4379-beef-01f0b123b9b1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:22.495448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 507/1017] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 16 00:21:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:22.500943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8335d7d-c558-4379-beef-01f0b123b9b1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:22.513428 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:22.519152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 511/1018] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:22.542434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea04bd7-e919-4e65-bc7e-817c239725bf None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:22.609939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8335d7d-c558-4379-beef-01f0b123b9b1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:22.645423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795da84-6aad-426c-8a46-f51d5cb6ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:22.646077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795da84-6aad-426c-8a46-f51d5cb6ff74 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.646235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:22.646345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795da84-6aad-426c-8a46-f51d5cb6ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.646611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795da84-6aad-426c-8a46-f51d5cb6ff74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.647338 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795da84-6aad-426c-8a46-f51d5cb6ff74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:22.648848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795da84-6aad-426c-8a46-f51d5cb6ff74 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:22.650632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea04bd7-e919-4e65-bc7e-817c239725bf None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:22.684392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7e4b-d7f1-4df4-a3ae-e52ab48f2926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:22.684983 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7e4b-d7f1-4df4-a3ae-e52ab48f2926 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.685261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7e4b-d7f1-4df4-a3ae-e52ab48f2926 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.685534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7e4b-d7f1-4df4-a3ae-e52ab48f2926 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.686232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c7e4b-d7f1-4df4-a3ae-e52ab48f2926 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:22.687589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c7e4b-d7f1-4df4-a3ae-e52ab48f2926 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:22.774903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 512/1019] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:21:22 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:21:22.775324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 508/1020] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 16 00:21:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:21:23.523036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113fa7c-035c-48e8-a74f-7cde566e38ea None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:23.523585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113fa7c-035c-48e8-a74f-7cde566e38ea None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:23.523585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113fa7c-035c-48e8-a74f-7cde566e38ea None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:23.525035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 513/1021] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:23.530198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f019cbc-23a9-4705-8112-c4254455d55f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:23.530585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f019cbc-23a9-4705-8112-c4254455d55f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:23.530754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f019cbc-23a9-4705-8112-c4254455d55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:23.548075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5f019cbc-23a9-4705-8112-c4254455d55f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:23.549253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5f019cbc-23a9-4705-8112-c4254455d55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:23.609985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:23.624438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 509/1022] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:23.649177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113fa7c-035c-48e8-a74f-7cde566e38ea None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:23.752889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113fa7c-035c-48e8-a74f-7cde566e38ea None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:23.785385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad1d31-1617-4572-bd2c-758f94a3ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:23.786102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad1d31-1617-4572-bd2c-758f94a3ba42 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:23.786380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad1d31-1617-4572-bd2c-758f94a3ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:23.786646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad1d31-1617-4572-bd2c-758f94a3ba42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:23.787932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad1d31-1617-4572-bd2c-758f94a3ba42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:23.789363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad1d31-1617-4572-bd2c-758f94a3ba42 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:23.791205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 514/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:23.797327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f019cbc-23a9-4705-8112-c4254455d55f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:23.897519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f019cbc-23a9-4705-8112-c4254455d55f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:23.932755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f17ee-57ad-4b72-be89-3f34d88b51f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:23.933424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f17ee-57ad-4b72-be89-3f34d88b51f5 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:23.933705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f17ee-57ad-4b72-be89-3f34d88b51f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:23.933978 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f17ee-57ad-4b72-be89-3f34d88b51f5 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:23.934689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f17ee-57ad-4b72-be89-3f34d88b51f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:23.936170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f17ee-57ad-4b72-be89-3f34d88b51f5 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:24.048757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 510/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:21:23 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:24.943811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e3aee-d416-4434-96ae-abaa8a02d2ef None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:24.944350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e3aee-d416-4434-96ae-abaa8a02d2ef None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:24.944350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e3aee-d416-4434-96ae-abaa8a02d2ef None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:24.945790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 515/1025] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:24.951764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793c3f-a0e9-426e-9649-139948341666 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:24.952281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793c3f-a0e9-426e-9649-139948341666 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:24.952358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793c3f-a0e9-426e-9649-139948341666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:24.970550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-58793c3f-a0e9-426e-9649-139948341666 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:24.971763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-58793c3f-a0e9-426e-9649-139948341666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:25.005312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b1cd1-ccac-47b7-9802-518943a10163 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.005595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b1cd1-ccac-47b7-9802-518943a10163 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.006051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b1cd1-ccac-47b7-9802-518943a10163 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.007841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 516/1026] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:25.012760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56669586-5450-47f7-a96d-d40a3f4f5028 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.013044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56669586-5450-47f7-a96d-d40a3f4f5028 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.013522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56669586-5450-47f7-a96d-d40a3f4f5028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.020926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:25.033823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-56669586-5450-47f7-a96d-d40a3f4f5028 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:25.035127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-56669586-5450-47f7-a96d-d40a3f4f5028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:25.050790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 511/1027] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:25.057666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:25.074284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793c3f-a0e9-426e-9649-139948341666 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.105641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 517/1028] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:25.128471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56669586-5450-47f7-a96d-d40a3f4f5028 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.176815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793c3f-a0e9-426e-9649-139948341666 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.213098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ab854-6d6a-493c-9d39-41d3384d234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.214481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab854-6d6a-493c-9d39-41d3384d234d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.214769 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab854-6d6a-493c-9d39-41d3384d234d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.215047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab854-6d6a-493c-9d39-41d3384d234d None admin] PATH_INFO: `/v3/services/image` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.215705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ab854-6d6a-493c-9d39-41d3384d234d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.217139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ab854-6d6a-493c-9d39-41d3384d234d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-751ab854-6d6a-493c-9d39-41d3384d234d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:25.230109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:25.231089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:25.231963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 512/1029] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:25.237236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ab854-6d6a-493c-9d39-41d3384d234d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.239548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56669586-5450-47f7-a96d-d40a3f4f5028 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.273965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394be3e-1a60-4a7b-9540-612d60d809bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.274770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394be3e-1a60-4a7b-9540-612d60d809bb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.275050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394be3e-1a60-4a7b-9540-612d60d809bb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.275330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394be3e-1a60-4a7b-9540-612d60d809bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.280714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:25.287448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394be3e-1a60-4a7b-9540-612d60d809bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-7394be3e-1a60-4a7b-9540-612d60d809bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:25.295602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:25.296643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:25.297486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 518/1030] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:25.302789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394be3e-1a60-4a7b-9540-612d60d809bb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.321686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:25.346391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ab854-6d6a-493c-9d39-41d3384d234d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.380015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d819-a154-4d56-83d1-33f5aafd4193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.380674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d819-a154-4d56-83d1-33f5aafd4193 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.380958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d819-a154-4d56-83d1-33f5aafd4193 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.381230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d819-a154-4d56-83d1-33f5aafd4193 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.382175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059d819-a154-4d56-83d1-33f5aafd4193 None admin] RBAC: Adding query filter params (name=image) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:25.382476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059d819-a154-4d56-83d1-33f5aafd4193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.383867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059d819-a154-4d56-83d1-33f5aafd4193 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:25.393784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 513/1031] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:25.394842 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d819-a154-4d56-83d1-33f5aafd4193 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.411046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394be3e-1a60-4a7b-9540-612d60d809bb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.444510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa7586-6dbb-4fae-b035-e6b3229462d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.445167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa7586-6dbb-4fae-b035-e6b3229462d3 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.445447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa7586-6dbb-4fae-b035-e6b3229462d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.445720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa7586-6dbb-4fae-b035-e6b3229462d3 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.446445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa7586-6dbb-4fae-b035-e6b3229462d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:25.446747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa7586-6dbb-4fae-b035-e6b3229462d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.448697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa7586-6dbb-4fae-b035-e6b3229462d3 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:25.456816 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 519/1032] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:25.461993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa7586-6dbb-4fae-b035-e6b3229462d3 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.501464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d819-a154-4d56-83d1-33f5aafd4193 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.504680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:25.538274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14e372-19ea-4c9a-930a-1531737c76a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.539184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14e372-19ea-4c9a-930a-1531737c76a8 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.539661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14e372-19ea-4c9a-930a-1531737c76a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.540523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14e372-19ea-4c9a-930a-1531737c76a8 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.541443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14e372-19ea-4c9a-930a-1531737c76a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:25.542271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14e372-19ea-4c9a-930a-1531737c76a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.543430 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:25.544300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14e372-19ea-4c9a-930a-1531737c76a8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:25.551010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 514/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:25.557776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14e372-19ea-4c9a-930a-1531737c76a8 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.565370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa7586-6dbb-4fae-b035-e6b3229462d3 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.607821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ca02-019a-4b43-81ad-0ada0f064a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.608830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ca02-019a-4b43-81ad-0ada0f064a37 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.609259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ca02-019a-4b43-81ad-0ada0f064a37 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.609704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ca02-019a-4b43-81ad-0ada0f064a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.621226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847ca02-019a-4b43-81ad-0ada0f064a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.622829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847ca02-019a-4b43-81ad-0ada0f064a37 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-c847ca02-019a-4b43-81ad-0ada0f064a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:25.642996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:25.643945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:25.644839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:25.644839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:25.644839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:25.644839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:25.644839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 520/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:25.649866 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ca02-019a-4b43-81ad-0ada0f064a37 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.666730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14e372-19ea-4c9a-930a-1531737c76a8 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.702556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2657866-f7c2-4814-b54e-baa028c3b415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.703219 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657866-f7c2-4814-b54e-baa028c3b415 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.703506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657866-f7c2-4814-b54e-baa028c3b415 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.703825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657866-f7c2-4814-b54e-baa028c3b415 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.704616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2657866-f7c2-4814-b54e-baa028c3b415 None admin] RBAC: Adding query filter params (interface=public, service_id=38af7794e1aa4e228e5cbb65bed78447, region_id=RegionOne) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:25.704934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2657866-f7c2-4814-b54e-baa028c3b415 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.706355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2657866-f7c2-4814-b54e-baa028c3b415 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:25.712106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 515/1035] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/endpoints?service_id=38af7794e1aa4e228e5cbb65bed78447&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:25.717539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2657866-f7c2-4814-b54e-baa028c3b415 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.749351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:25.762175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ca02-019a-4b43-81ad-0ada0f064a37 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.796118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:25.801291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cd25a-5a0c-4cfe-a07f-8bacbccfcf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.801952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cd25a-5a0c-4cfe-a07f-8bacbccfcf7a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.802470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cd25a-5a0c-4cfe-a07f-8bacbccfcf7a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.802581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cd25a-5a0c-4cfe-a07f-8bacbccfcf7a None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.803308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cd25a-5a0c-4cfe-a07f-8bacbccfcf7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:25.803574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cd25a-5a0c-4cfe-a07f-8bacbccfcf7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.804986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cd25a-5a0c-4cfe-a07f-8bacbccfcf7a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:25.821770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 521/1036] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:25.822841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cd25a-5a0c-4cfe-a07f-8bacbccfcf7a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.826408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2657866-f7c2-4814-b54e-baa028c3b415 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.862325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641333e6-4910-4dc3-8f93-aa08ce3222b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.862987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641333e6-4910-4dc3-8f93-aa08ce3222b9 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.863269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641333e6-4910-4dc3-8f93-aa08ce3222b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.863543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641333e6-4910-4dc3-8f93-aa08ce3222b9 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.864239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641333e6-4910-4dc3-8f93-aa08ce3222b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.865609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641333e6-4910-4dc3-8f93-aa08ce3222b9 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:25.873357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 516/1037] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:21:25.938989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cd25a-5a0c-4cfe-a07f-8bacbccfcf7a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.975201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabddcf4-472b-48fb-85e9-1f98bec74b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.976042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabddcf4-472b-48fb-85e9-1f98bec74b2e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.976314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabddcf4-472b-48fb-85e9-1f98bec74b2e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.976587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabddcf4-472b-48fb-85e9-1f98bec74b2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.985179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabddcf4-472b-48fb-85e9-1f98bec74b2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.986652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabddcf4-472b-48fb-85e9-1f98bec74b2e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-fabddcf4-472b-48fb-85e9-1f98bec74b2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:21:26.002831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:26.004138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:26.005120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 522/1038] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:26.013130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641333e6-4910-4dc3-8f93-aa08ce3222b9 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:26.111859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:26.117890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641333e6-4910-4dc3-8f93-aa08ce3222b9 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:26.152105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee8b4b-a0e0-49e6-83a7-82c651ef1de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:26.153224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8b4b-a0e0-49e6-83a7-82c651ef1de1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:26.154020 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8b4b-a0e0-49e6-83a7-82c651ef1de1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:26.154299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee8b4b-a0e0-49e6-83a7-82c651ef1de1 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:26.155152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee8b4b-a0e0-49e6-83a7-82c651ef1de1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:26.155463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee8b4b-a0e0-49e6-83a7-82c651ef1de1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:26.156933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee8b4b-a0e0-49e6-83a7-82c651ef1de1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:26.179686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 517/1039] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 16 00:21:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:26.181578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabddcf4-472b-48fb-85e9-1f98bec74b2e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:26.235535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:26.248970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e26e-b0a8-4da9-b11f-826dd1596af2 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:26.249164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e26e-b0a8-4da9-b11f-826dd1596af2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:26.249446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e26e-b0a8-4da9-b11f-826dd1596af2 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:26.250856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 518/1040] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:26.255839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc12f-fe7b-45e1-89f6-9a104b6f7bf7 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:26.264054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc12f-fe7b-45e1-89f6-9a104b6f7bf7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:26.264054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc12f-fe7b-45e1-89f6-9a104b6f7bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:26.273334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-b05dc12f-fe7b-45e1-89f6-9a104b6f7bf7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:26.274525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b05dc12f-fe7b-45e1-89f6-9a104b6f7bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:26.286405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabddcf4-472b-48fb-85e9-1f98bec74b2e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:26.324332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a93fa5-21fc-4020-aa3d-e36dd1008e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:26.325100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93fa5-21fc-4020-aa3d-e36dd1008e9e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:26.325327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93fa5-21fc-4020-aa3d-e36dd1008e9e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:26.325612 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93fa5-21fc-4020-aa3d-e36dd1008e9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:26.343153 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 519/1041] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:26.366446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dc12f-fe7b-45e1-89f6-9a104b6f7bf7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:26.397322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a93fa5-21fc-4020-aa3d-e36dd1008e9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:26.398775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a93fa5-21fc-4020-aa3d-e36dd1008e9e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:26.448569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:26.451599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:26.467615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dc12f-fe7b-45e1-89f6-9a104b6f7bf7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:26.502783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 523/1042] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:21:26.504914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1896b6-1ebf-4b88-8878-2eac38693fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:26.505706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1896b6-1ebf-4b88-8878-2eac38693fa1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:26.505985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1896b6-1ebf-4b88-8878-2eac38693fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:26.506257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1896b6-1ebf-4b88-8878-2eac38693fa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:26.508608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a93fa5-21fc-4020-aa3d-e36dd1008e9e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:26.518238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1896b6-1ebf-4b88-8878-2eac38693fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-0d1896b6-1ebf-4b88-8878-2eac38693fa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:26.526067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:26.527006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:26.527886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 520/1043] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:21:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:26.533221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1896b6-1ebf-4b88-8878-2eac38693fa1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:26.615334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a93fa5-21fc-4020-aa3d-e36dd1008e9e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:26.641325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1896b6-1ebf-4b88-8878-2eac38693fa1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:26.650913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cee99-4076-46da-9732-c56d5af407db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:26.651845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cee99-4076-46da-9732-c56d5af407db None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:26.652124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cee99-4076-46da-9732-c56d5af407db None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:26.652396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cee99-4076-46da-9732-c56d5af407db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:26.663314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cee99-4076-46da-9732-c56d5af407db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:26.664893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cee99-4076-46da-9732-c56d5af407db None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:26.674884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f5c91-adb1-484c-ba96-3cf1bbd35c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:26.675552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5c91-adb1-484c-ba96-3cf1bbd35c8d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:26.675862 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5c91-adb1-484c-ba96-3cf1bbd35c8d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:26.676138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5c91-adb1-484c-ba96-3cf1bbd35c8d None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:26.676875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f5c91-adb1-484c-ba96-3cf1bbd35c8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:26.677181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f5c91-adb1-484c-ba96-3cf1bbd35c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:26.678559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f5c91-adb1-484c-ba96-3cf1bbd35c8d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-d52cee99-4076-46da-9732-c56d5af407db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:26.684085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:26.684988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:26.685881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:26.685881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:26.685881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:26.685881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:26.685881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 524/1044] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:26.690173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 521/1045] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:21:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:26.691276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cee99-4076-46da-9732-c56d5af407db None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:26.694084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:26.695500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f5c91-adb1-484c-ba96-3cf1bbd35c8d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:26.704493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:26.795898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cee99-4076-46da-9732-c56d5af407db None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:26.804676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f5c91-adb1-484c-ba96-3cf1bbd35c8d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:26.834600 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd9260-a154-4d0e-a6b9-4aa9b48ad7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:26.835265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd9260-a154-4d0e-a6b9-4aa9b48ad7fb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:26.835548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd9260-a154-4d0e-a6b9-4aa9b48ad7fb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:26.835854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd9260-a154-4d0e-a6b9-4aa9b48ad7fb None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:26.836444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278086d-b788-4145-9d74-cff6f87a9f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:26.836567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd9260-a154-4d0e-a6b9-4aa9b48ad7fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:26.836861 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd9260-a154-4d0e-a6b9-4aa9b48ad7fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:26.837303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278086d-b788-4145-9d74-cff6f87a9f9c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:26.837582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278086d-b788-4145-9d74-cff6f87a9f9c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:26.837854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278086d-b788-4145-9d74-cff6f87a9f9c None admin] PATH_INFO: `/v3/users/36c73f145c9a489082242b249ac2aa60` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:26.838250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd9260-a154-4d0e-a6b9-4aa9b48ad7fb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:26.849501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 525/1046] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:26.851953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278086d-b788-4145-9d74-cff6f87a9f9c None admin] RBAC: Authorizing `identity:get_user(user_id=36c73f145c9a489082242b249ac2aa60)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:26.853401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278086d-b788-4145-9d74-cff6f87a9f9c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:26.860308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 522/1047] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:26 2022] GET /identity/v3/users/36c73f145c9a489082242b249ac2aa60 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:26.860439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd9260-a154-4d0e-a6b9-4aa9b48ad7fb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:26.861340 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278086d-b788-4145-9d74-cff6f87a9f9c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:26.923195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:26.929014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:26.965289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd9260-a154-4d0e-a6b9-4aa9b48ad7fb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:26.968767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278086d-b788-4145-9d74-cff6f87a9f9c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:27.004440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbf1bd-3fb8-4db3-9e5a-7af8c5606d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:27.005281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbf1bd-3fb8-4db3-9e5a-7af8c5606d7f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:27.005584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbf1bd-3fb8-4db3-9e5a-7af8c5606d7f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:27.005859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbf1bd-3fb8-4db3-9e5a-7af8c5606d7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:27.005969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc41b5-e2a1-4b05-90d9-3c49e81f1f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:27.006918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc41b5-e2a1-4b05-90d9-3c49e81f1f74 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:27.007208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc41b5-e2a1-4b05-90d9-3c49e81f1f74 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:27.007484 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc41b5-e2a1-4b05-90d9-3c49e81f1f74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:27.013053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbf1bd-3fb8-4db3-9e5a-7af8c5606d7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:27.014497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbf1bd-3fb8-4db3-9e5a-7af8c5606d7f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e8fbf1bd-3fb8-4db3-9e5a-7af8c5606d7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:21:27.029388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:27.030322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:27.031240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:21:27.031240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:21:27.031240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:21:27.031240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:21:27.031240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:21:27.031240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:21:27.031240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:27.031240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:27.031240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 526/1048] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:27.039038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbf1bd-3fb8-4db3-9e5a-7af8c5606d7f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:27.091195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc41b5-e2a1-4b05-90d9-3c49e81f1f74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:27.092764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc41b5-e2a1-4b05-90d9-3c49e81f1f74 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:27.141950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbf1bd-3fb8-4db3-9e5a-7af8c5606d7f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:27.154221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:27.165307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:27.177609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2ff9f-a138-4316-88e2-9b81e6f1502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:27.178267 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2ff9f-a138-4316-88e2-9b81e6f1502b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:27.178552 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2ff9f-a138-4316-88e2-9b81e6f1502b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:27.178831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2ff9f-a138-4316-88e2-9b81e6f1502b None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:27.179607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2ff9f-a138-4316-88e2-9b81e6f1502b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:27.179943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2ff9f-a138-4316-88e2-9b81e6f1502b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:27.181369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2ff9f-a138-4316-88e2-9b81e6f1502b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:27.193516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 527/1049] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:27.197616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 523/1050] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:27.199289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2ff9f-a138-4316-88e2-9b81e6f1502b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:27.203231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc41b5-e2a1-4b05-90d9-3c49e81f1f74 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:27.304619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2ff9f-a138-4316-88e2-9b81e6f1502b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:27.309210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc41b5-e2a1-4b05-90d9-3c49e81f1f74 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:27.337987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76363-a294-498d-9975-29388fb7cec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:27.339175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76363-a294-498d-9975-29388fb7cec6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:27.339460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76363-a294-498d-9975-29388fb7cec6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:27.339756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76363-a294-498d-9975-29388fb7cec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:27.340579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76363-a294-498d-9975-29388fb7cec6 None admin] RBAC: Adding query filter params (role.id=f67c45ce861841519313d6585e5bd3fe, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=ba29f9c029fe4390af3b6ce1b2147ce9) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:27.340890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76363-a294-498d-9975-29388fb7cec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:27.342370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76363-a294-498d-9975-29388fb7cec6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:27.347934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 528/1051] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:27 2022] GET /identity/v3/role_assignments?user.id=ba29f9c029fe4390af3b6ce1b2147ce9&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=f67c45ce861841519313d6585e5bd3fe => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:27.348210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7bb49-26ed-4eb4-a68c-5a34db7fe982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:27.349107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7bb49-26ed-4eb4-a68c-5a34db7fe982 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:27.349395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7bb49-26ed-4eb4-a68c-5a34db7fe982 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:27.349675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7bb49-26ed-4eb4-a68c-5a34db7fe982 None admin] PATH_INFO: `/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:27.350884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7bb49-26ed-4eb4-a68c-5a34db7fe982 None admin] RBAC: Authorizing `identity:get_project(project_id=a46a1adaa6da4666b7cb29ac5b16180b)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:27.352387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7bb49-26ed-4eb4-a68c-5a34db7fe982 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:27.354341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 524/1052] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:21:27 2022] GET /identity/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:27.360461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76363-a294-498d-9975-29388fb7cec6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:27.413104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:27.470952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76363-a294-498d-9975-29388fb7cec6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:27.507935 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a46dc-b8ef-44c0-8637-a8f458afd10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:27.508688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a46dc-b8ef-44c0-8637-a8f458afd10b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:27.508977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a46dc-b8ef-44c0-8637-a8f458afd10b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:27.509256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a46dc-b8ef-44c0-8637-a8f458afd10b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:27.510663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a46dc-b8ef-44c0-8637-a8f458afd10b None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=a46a1adaa6da4666b7cb29ac5b16180b, user.id=36c73f145c9a489082242b249ac2aa60) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:27.510960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a46dc-b8ef-44c0-8637-a8f458afd10b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:27.513098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a46dc-b8ef-44c0-8637-a8f458afd10b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:27.518732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 529/1053] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:27 2022] GET /identity/v3/role_assignments?user.id=36c73f145c9a489082242b249ac2aa60&scope.project.id=a46a1adaa6da4666b7cb29ac5b16180b&role.id=635caa85d8524fb887206fd521defd3f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:28.026518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86e84-4591-4497-9254-a1fd960437c6 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:28.026902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86e84-4591-4497-9254-a1fd960437c6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:28.027141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86e84-4591-4497-9254-a1fd960437c6 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:28.028764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 525/1054] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:28.034273 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af10732-2034-4962-8c8b-252f7e5cffc2 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:28.034704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af10732-2034-4962-8c8b-252f7e5cffc2 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:28.034842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af10732-2034-4962-8c8b-252f7e5cffc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:28.056636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4af10732-2034-4962-8c8b-252f7e5cffc2 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:28.058418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4af10732-2034-4962-8c8b-252f7e5cffc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:28.127770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 530/1055] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:28.149381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86e84-4591-4497-9254-a1fd960437c6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:28.181579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:28.252291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86e84-4591-4497-9254-a1fd960437c6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:28.285237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cef92-7275-4186-a38f-3e2d99197850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:28.285938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cef92-7275-4186-a38f-3e2d99197850 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:28.286222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cef92-7275-4186-a38f-3e2d99197850 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:28.286488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cef92-7275-4186-a38f-3e2d99197850 None admin] PATH_INFO: `/v3/services/image` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:28.287129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cef92-7275-4186-a38f-3e2d99197850 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:28.288518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cef92-7275-4186-a38f-3e2d99197850 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-4a8cef92-7275-4186-a38f-3e2d99197850 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:28.300734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:28.301780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:21:28.302651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:28.306765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 526/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Jun 16 00:21:28 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:28.308575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af10732-2034-4962-8c8b-252f7e5cffc2 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:28.347990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:28.407534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af10732-2034-4962-8c8b-252f7e5cffc2 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:28.441207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f8f55-5605-48c8-9831-ed375cbf2c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:28.441892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f8f55-5605-48c8-9831-ed375cbf2c09 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:28.442171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f8f55-5605-48c8-9831-ed375cbf2c09 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:28.442445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f8f55-5605-48c8-9831-ed375cbf2c09 None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:28.443155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f8f55-5605-48c8-9831-ed375cbf2c09 None admin] RBAC: Adding query filter params (name=image) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:28.443458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f8f55-5605-48c8-9831-ed375cbf2c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:28.444880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f8f55-5605-48c8-9831-ed375cbf2c09 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:28.455097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 531/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:28.456344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cef92-7275-4186-a38f-3e2d99197850 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:28.553327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:28.559533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cef92-7275-4186-a38f-3e2d99197850 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:28.594988 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec39db5-d265-4109-898b-d62f915dc841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:28.595653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec39db5-d265-4109-898b-d62f915dc841 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:28.595964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec39db5-d265-4109-898b-d62f915dc841 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:28.596243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec39db5-d265-4109-898b-d62f915dc841 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:28.596956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec39db5-d265-4109-898b-d62f915dc841 None admin] RBAC: Adding query filter params (type=image) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:28.597264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec39db5-d265-4109-898b-d62f915dc841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:28.598637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec39db5-d265-4109-898b-d62f915dc841 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:28.608794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 527/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:28.610275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f8f55-5605-48c8-9831-ed375cbf2c09 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:28.713932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f8f55-5605-48c8-9831-ed375cbf2c09 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:28.716982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:28.748008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691f32a-dba2-431e-94b5-5b29c00bae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:28.748663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691f32a-dba2-431e-94b5-5b29c00bae53 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:28.748950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691f32a-dba2-431e-94b5-5b29c00bae53 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:28.749230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691f32a-dba2-431e-94b5-5b29c00bae53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:28.749969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691f32a-dba2-431e-94b5-5b29c00bae53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:28.751332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691f32a-dba2-431e-94b5-5b29c00bae53 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:28.831977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 532/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 16 00:21:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:29.488769 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e0378-b89f-4bbb-ab9f-42533e03174f None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:29.489331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e0378-b89f-4bbb-ab9f-42533e03174f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:29.489331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e0378-b89f-4bbb-ab9f-42533e03174f None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:29.490829 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 528/1060] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:29.496412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd1b23-721a-4a6d-8775-517f047453b9 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:29.496794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd1b23-721a-4a6d-8775-517f047453b9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:29.496971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd1b23-721a-4a6d-8775-517f047453b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:29.514881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-2acd1b23-721a-4a6d-8775-517f047453b9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:29.516086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-2acd1b23-721a-4a6d-8775-517f047453b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:29.595392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 533/1061] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:29.618036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e0378-b89f-4bbb-ab9f-42533e03174f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:29.624367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f3fca-6898-47fe-9f8d-319aac0442dc None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:29.624664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f3fca-6898-47fe-9f8d-319aac0442dc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:29.624946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f3fca-6898-47fe-9f8d-319aac0442dc None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:29.626604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 534/1062] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:29.631795 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358a2ae-cdcb-4b52-baa7-352a27583f0d None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:29.632449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358a2ae-cdcb-4b52-baa7-352a27583f0d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:29.632728 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358a2ae-cdcb-4b52-baa7-352a27583f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:29.650017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4358a2ae-cdcb-4b52-baa7-352a27583f0d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:29.651230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4358a2ae-cdcb-4b52-baa7-352a27583f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:29.719550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e0378-b89f-4bbb-ab9f-42533e03174f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:29.723914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 535/1063] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:29.743132 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358a2ae-cdcb-4b52-baa7-352a27583f0d None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:29.761211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:29.761472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdf19c-3b5b-4808-aed2-5dd2d2f7680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:29.763242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf19c-3b5b-4808-aed2-5dd2d2f7680e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:29.763525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf19c-3b5b-4808-aed2-5dd2d2f7680e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:29.763843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf19c-3b5b-4808-aed2-5dd2d2f7680e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:29.778403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdf19c-3b5b-4808-aed2-5dd2d2f7680e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-41fdf19c-3b5b-4808-aed2-5dd2d2f7680e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:29.787937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:29.788848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:29.789685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:29.790313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 529/1064] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 16 00:21:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:29.796262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdf19c-3b5b-4808-aed2-5dd2d2f7680e None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:29.818496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:29.847317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358a2ae-cdcb-4b52-baa7-352a27583f0d None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:29.883413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2530f-d73c-44b9-b9c4-01de4c614758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:29.884232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2530f-d73c-44b9-b9c4-01de4c614758 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:29.884517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2530f-d73c-44b9-b9c4-01de4c614758 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:29.884786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2530f-d73c-44b9-b9c4-01de4c614758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:29.895098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2530f-d73c-44b9-b9c4-01de4c614758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:29.900364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdf19c-3b5b-4808-aed2-5dd2d2f7680e None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e3c2530f-d73c-44b9-b9c4-01de4c614758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:29.903683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:29.904741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:29.905585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 536/1065] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:29.911794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2530f-d73c-44b9-b9c4-01de4c614758 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:29.946036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084621-93c0-41ac-850f-47312910da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:29.946699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084621-93c0-41ac-850f-47312910da44 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:29.946976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084621-93c0-41ac-850f-47312910da44 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:29.947244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e084621-93c0-41ac-850f-47312910da44 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:29.948056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e084621-93c0-41ac-850f-47312910da44 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:29.948359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e084621-93c0-41ac-850f-47312910da44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:29.949725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e084621-93c0-41ac-850f-47312910da44 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:29.958152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 530/1066] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 16 00:21:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:29.964336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084621-93c0-41ac-850f-47312910da44 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:29.995197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:30.020173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2530f-d73c-44b9-b9c4-01de4c614758 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.060352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:30.062303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006fc59-ea5c-4e87-a38c-5e8aec676e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:30.062973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fc59-ea5c-4e87-a38c-5e8aec676e76 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.063254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fc59-ea5c-4e87-a38c-5e8aec676e76 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.063530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fc59-ea5c-4e87-a38c-5e8aec676e76 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.064298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006fc59-ea5c-4e87-a38c-5e8aec676e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:30.064608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006fc59-ea5c-4e87-a38c-5e8aec676e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:30.065974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006fc59-ea5c-4e87-a38c-5e8aec676e76 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:30.074455 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 537/1067] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:30.079626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e084621-93c0-41ac-850f-47312910da44 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.080104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006fc59-ea5c-4e87-a38c-5e8aec676e76 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:30.115449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524544b-8017-4ca7-acd3-7737302dbfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:30.116415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524544b-8017-4ca7-acd3-7737302dbfd7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.116843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524544b-8017-4ca7-acd3-7737302dbfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.117126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524544b-8017-4ca7-acd3-7737302dbfd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.127966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524544b-8017-4ca7-acd3-7737302dbfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:30.129429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524544b-8017-4ca7-acd3-7737302dbfd7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-6524544b-8017-4ca7-acd3-7737302dbfd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:30.146768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:30.147653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:30.148573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:30.148573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:30.148573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:30.148573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:30.148573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 531/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:30.154044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524544b-8017-4ca7-acd3-7737302dbfd7 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:30.185976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006fc59-ea5c-4e87-a38c-5e8aec676e76 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.219098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c3753-4b40-48b2-8edc-6a1f74fddd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:30.220005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c3753-4b40-48b2-8edc-6a1f74fddd44 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.220295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c3753-4b40-48b2-8edc-6a1f74fddd44 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.220575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c3753-4b40-48b2-8edc-6a1f74fddd44 None admin] PATH_INFO: `/v3/users/36c73f145c9a489082242b249ac2aa60` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.221777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c3753-4b40-48b2-8edc-6a1f74fddd44 None admin] RBAC: Authorizing `identity:get_user(user_id=36c73f145c9a489082242b249ac2aa60)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:30.223200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c3753-4b40-48b2-8edc-6a1f74fddd44 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:30.224875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 538/1069] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:30 2022] GET /identity/v3/users/36c73f145c9a489082242b249ac2aa60 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:30.231092 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c3753-4b40-48b2-8edc-6a1f74fddd44 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:30.240654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:30.265095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524544b-8017-4ca7-acd3-7737302dbfd7 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.302825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d63cd-e3a5-4cca-99d0-611e5bd20206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:30.303643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d63cd-e3a5-4cca-99d0-611e5bd20206 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.303954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d63cd-e3a5-4cca-99d0-611e5bd20206 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.304963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d63cd-e3a5-4cca-99d0-611e5bd20206 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.305688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d63cd-e3a5-4cca-99d0-611e5bd20206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:30.306004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d63cd-e3a5-4cca-99d0-611e5bd20206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:30.307405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d63cd-e3a5-4cca-99d0-611e5bd20206 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:30.308989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:30.325473 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 532/1070] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:30.326634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d63cd-e3a5-4cca-99d0-611e5bd20206 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:30.334283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c3753-4b40-48b2-8edc-6a1f74fddd44 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.371271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b6312-0459-4380-aaf0-f9465cfb97cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:30.372155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6312-0459-4380-aaf0-f9465cfb97cc None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.372441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6312-0459-4380-aaf0-f9465cfb97cc None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.372721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6312-0459-4380-aaf0-f9465cfb97cc None admin] PATH_INFO: `/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.373913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b6312-0459-4380-aaf0-f9465cfb97cc None admin] RBAC: Authorizing `identity:get_project(project_id=a46a1adaa6da4666b7cb29ac5b16180b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:30.375336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b6312-0459-4380-aaf0-f9465cfb97cc None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:30.381994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 539/1071] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:21:30 2022] GET /identity/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:30.382930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b6312-0459-4380-aaf0-f9465cfb97cc None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:30.432333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d63cd-e3a5-4cca-99d0-611e5bd20206 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.467461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:30.471128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bf593-1e11-4651-b9ef-085133ec1203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:30.472247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bf593-1e11-4651-b9ef-085133ec1203 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.472543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bf593-1e11-4651-b9ef-085133ec1203 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.472825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bf593-1e11-4651-b9ef-085133ec1203 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.482121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bf593-1e11-4651-b9ef-085133ec1203 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:30.484353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bf593-1e11-4651-b9ef-085133ec1203 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:30.491240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b6312-0459-4380-aaf0-f9465cfb97cc None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-c49bf593-1e11-4651-b9ef-085133ec1203 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:21:30.503148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:30.504618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:30.505571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 533/1072] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 16 00:21:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:30.511118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bf593-1e11-4651-b9ef-085133ec1203 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:30.529591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f1af-3d88-4743-ac3e-0ada8f990903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:30.530775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f1af-3d88-4743-ac3e-0ada8f990903 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.531208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f1af-3d88-4743-ac3e-0ada8f990903 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.531497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f1af-3d88-4743-ac3e-0ada8f990903 None admin] PATH_INFO: `/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b/users/36c73f145c9a489082242b249ac2aa60/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.533606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444f1af-3d88-4743-ac3e-0ada8f990903 None admin] RBAC: Authorizing `identity:create_grant(project_id=a46a1adaa6da4666b7cb29ac5b16180b, user_id=36c73f145c9a489082242b249ac2aa60, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:30.535031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444f1af-3d88-4743-ac3e-0ada8f990903 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:30.570715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:30.609501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 540/1073] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:21:30 2022] PUT /identity/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b/users/36c73f145c9a489082242b249ac2aa60/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:21:30.613990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bf593-1e11-4651-b9ef-085133ec1203 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.654707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5a626-2a9d-4915-95de-eb5d7ad5cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:30.655402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5a626-2a9d-4915-95de-eb5d7ad5cc5d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.655688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5a626-2a9d-4915-95de-eb5d7ad5cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.656000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5a626-2a9d-4915-95de-eb5d7ad5cc5d None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.656853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5a626-2a9d-4915-95de-eb5d7ad5cc5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:30.657169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5a626-2a9d-4915-95de-eb5d7ad5cc5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:30.658652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5a626-2a9d-4915-95de-eb5d7ad5cc5d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:30.683643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 534/1074] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 16 00:21:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:30.685075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f1af-3d88-4743-ac3e-0ada8f990903 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:30.793586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f1af-3d88-4743-ac3e-0ada8f990903 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.827699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be690d3d-0084-4b3b-aae8-7b861eaf7649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:30.828577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be690d3d-0084-4b3b-aae8-7b861eaf7649 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.828865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be690d3d-0084-4b3b-aae8-7b861eaf7649 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.829147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be690d3d-0084-4b3b-aae8-7b861eaf7649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.831466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:30.840576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be690d3d-0084-4b3b-aae8-7b861eaf7649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:30.842016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be690d3d-0084-4b3b-aae8-7b861eaf7649 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-be690d3d-0084-4b3b-aae8-7b861eaf7649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:30.858698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:30.859899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:30.860821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:30.860821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:30.860821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:30.860821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:30.860821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 541/1075] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:30.865554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5a626-2a9d-4915-95de-eb5d7ad5cc5d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:30.971183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5a626-2a9d-4915-95de-eb5d7ad5cc5d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:30.984630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:30.988022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870e769-bdda-4b74-990f-e368a8ad1aa6 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.988310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870e769-bdda-4b74-990f-e368a8ad1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.988590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870e769-bdda-4b74-990f-e368a8ad1aa6 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.989965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 542/1076] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:30.995598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce99b8-0eac-48df-a602-3af822bdbe7f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.995921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce99b8-0eac-48df-a602-3af822bdbe7f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.996200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce99b8-0eac-48df-a602-3af822bdbe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:31.010906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03a416-f8aa-43ff-b99a-a443d9a14256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:31.011889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03a416-f8aa-43ff-b99a-a443d9a14256 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:31.012370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03a416-f8aa-43ff-b99a-a443d9a14256 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:31.012856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03a416-f8aa-43ff-b99a-a443d9a14256 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:31.013781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03a416-f8aa-43ff-b99a-a443d9a14256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:31.013899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ffce99b8-0eac-48df-a602-3af822bdbe7f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:31.014421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03a416-f8aa-43ff-b99a-a443d9a14256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:31.015018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ffce99b8-0eac-48df-a602-3af822bdbe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:31.016574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03a416-f8aa-43ff-b99a-a443d9a14256 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:31.036481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 535/1077] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:31.040122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03a416-f8aa-43ff-b99a-a443d9a14256 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:31.095061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 543/1078] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:31.117468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce99b8-0eac-48df-a602-3af822bdbe7f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:31.145007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03a416-f8aa-43ff-b99a-a443d9a14256 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:31.181398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dde78-5967-4394-b3e2-a0f119e7f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:31.182740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dde78-5967-4394-b3e2-a0f119e7f638 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:31.183025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dde78-5967-4394-b3e2-a0f119e7f638 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:31.183305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dde78-5967-4394-b3e2-a0f119e7f638 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:31.190240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dde78-5967-4394-b3e2-a0f119e7f638 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:31.191692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dde78-5967-4394-b3e2-a0f119e7f638 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-f11dde78-5967-4394-b3e2-a0f119e7f638 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:21:31.205977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:31.207055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 536/1079] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:31.212670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dde78-5967-4394-b3e2-a0f119e7f638 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:31.226118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce99b8-0eac-48df-a602-3af822bdbe7f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:31.243619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:31.246679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:31.262611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ec30f-f6b2-4015-9afd-87a410bed551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:31.263258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ec30f-f6b2-4015-9afd-87a410bed551 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:31.263537 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ec30f-f6b2-4015-9afd-87a410bed551 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:31.263995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ec30f-f6b2-4015-9afd-87a410bed551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:31.321720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dde78-5967-4394-b3e2-a0f119e7f638 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:31.332127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ec30f-f6b2-4015-9afd-87a410bed551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:31.333637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ec30f-f6b2-4015-9afd-87a410bed551 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:31.359662 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd025e6-a70b-48ce-b39f-4269ea8dfdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:31.360355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd025e6-a70b-48ce-b39f-4269ea8dfdb1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:31.360752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd025e6-a70b-48ce-b39f-4269ea8dfdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:31.361026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd025e6-a70b-48ce-b39f-4269ea8dfdb1 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:31.361835 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd025e6-a70b-48ce-b39f-4269ea8dfdb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:31.362132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd025e6-a70b-48ce-b39f-4269ea8dfdb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:31.363796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd025e6-a70b-48ce-b39f-4269ea8dfdb1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:31.380554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 537/1080] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:31.381809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd025e6-a70b-48ce-b39f-4269ea8dfdb1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:31.442940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 544/1081] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:21:31.449434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ec30f-f6b2-4015-9afd-87a410bed551 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:31.466485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:31.479283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:31.487976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd025e6-a70b-48ce-b39f-4269ea8dfdb1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:31.526326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387e8ac-1edf-4c82-9811-c4c6e121ce0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:31.527823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387e8ac-1edf-4c82-9811-c4c6e121ce0c None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:31.528142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387e8ac-1edf-4c82-9811-c4c6e121ce0c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:31.528423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387e8ac-1edf-4c82-9811-c4c6e121ce0c None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/ba29f9c029fe4390af3b6ce1b2147ce9/roles/f67c45ce861841519313d6585e5bd3fe` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:31.531407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387e8ac-1edf-4c82-9811-c4c6e121ce0c None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=ba29f9c029fe4390af3b6ce1b2147ce9, role_id=f67c45ce861841519313d6585e5bd3fe)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:31.533313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387e8ac-1edf-4c82-9811-c4c6e121ce0c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:31.547467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ec30f-f6b2-4015-9afd-87a410bed551 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:31.581255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5caa0e6-a348-4bbe-924c-c8694c82b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:31.582038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caa0e6-a348-4bbe-924c-c8694c82b010 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:31.582325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caa0e6-a348-4bbe-924c-c8694c82b010 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:31.582626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caa0e6-a348-4bbe-924c-c8694c82b010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:31.590442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 538/1082] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:21:31 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/ba29f9c029fe4390af3b6ce1b2147ce9/roles/f67c45ce861841519313d6585e5bd3fe => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:21:31.602896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5caa0e6-a348-4bbe-924c-c8694c82b010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:31.604561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5caa0e6-a348-4bbe-924c-c8694c82b010 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e5caa0e6-a348-4bbe-924c-c8694c82b010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:31.625034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:31.625988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:31.632569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:31.632569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:31.632569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:31.632569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:31.632569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 545/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:31.634301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387e8ac-1edf-4c82-9811-c4c6e121ce0c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:31.745494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387e8ac-1edf-4c82-9811-c4c6e121ce0c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:31.781796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8d741-7448-4010-814c-391d95d79a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:31.782472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8d741-7448-4010-814c-391d95d79a69 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:31.782754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8d741-7448-4010-814c-391d95d79a69 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:31.783030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8d741-7448-4010-814c-391d95d79a69 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:31.783772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8d741-7448-4010-814c-391d95d79a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:31.784077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8d741-7448-4010-814c-391d95d79a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:31.785475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8d741-7448-4010-814c-391d95d79a69 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:31.798257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 539/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:32.731511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b1025-eb27-46e7-8f88-39e1587f57f8 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:32.732105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b1025-eb27-46e7-8f88-39e1587f57f8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:32.732105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b1025-eb27-46e7-8f88-39e1587f57f8 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:32.733487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 546/1085] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:32.738792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ee6a9-5402-4136-bdff-654fdb6d01c0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:32.739210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ee6a9-5402-4136-bdff-654fdb6d01c0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:32.739466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ee6a9-5402-4136-bdff-654fdb6d01c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:32.755431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-101ee6a9-5402-4136-bdff-654fdb6d01c0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:32.756883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-101ee6a9-5402-4136-bdff-654fdb6d01c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:32.765033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:32.820841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 540/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:32.844624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b1025-eb27-46e7-8f88-39e1587f57f8 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:32.910697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:32.943653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b1025-eb27-46e7-8f88-39e1587f57f8 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:32.975764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d493dea-73ad-4677-a117-f6c98456b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:32.976532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493dea-73ad-4677-a117-f6c98456b048 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:32.976812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493dea-73ad-4677-a117-f6c98456b048 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:32.977086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493dea-73ad-4677-a117-f6c98456b048 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:32.986768 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d493dea-73ad-4677-a117-f6c98456b048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-6d493dea-73ad-4677-a117-f6c98456b048 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:32.994725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:32.995639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:32.996750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 547/1087] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:33.001756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ee6a9-5402-4136-bdff-654fdb6d01c0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:33.102421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ee6a9-5402-4136-bdff-654fdb6d01c0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:33.134497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f51d-1455-4c9b-bc56-2b8e20db250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:33.135706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f51d-1455-4c9b-bc56-2b8e20db250e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.136010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f51d-1455-4c9b-bc56-2b8e20db250e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.136286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f51d-1455-4c9b-bc56-2b8e20db250e None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.137024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070f51d-1455-4c9b-bc56-2b8e20db250e None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:33.137328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070f51d-1455-4c9b-bc56-2b8e20db250e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:33.138698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070f51d-1455-4c9b-bc56-2b8e20db250e None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:33.147603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 541/1088] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:21:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:33.153376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d493dea-73ad-4677-a117-f6c98456b048 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:33.253131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d493dea-73ad-4677-a117-f6c98456b048 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:33.279134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:33.286909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa489ef-b2b8-4c70-be6b-fca7bcbd2e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:33.290778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa489ef-b2b8-4c70-be6b-fca7bcbd2e24 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.290778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa489ef-b2b8-4c70-be6b-fca7bcbd2e24 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.290778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa489ef-b2b8-4c70-be6b-fca7bcbd2e24 None admin] PATH_INFO: `/v3/users/36c73f145c9a489082242b249ac2aa60` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.290778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa489ef-b2b8-4c70-be6b-fca7bcbd2e24 None admin] RBAC: Authorizing `identity:get_user(user_id=36c73f145c9a489082242b249ac2aa60)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:33.291588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa489ef-b2b8-4c70-be6b-fca7bcbd2e24 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:33.292994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 548/1089] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:33 2022] GET /identity/v3/users/36c73f145c9a489082242b249ac2aa60 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:33.298705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f51d-1455-4c9b-bc56-2b8e20db250e None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:33.302507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:33.396224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f51d-1455-4c9b-bc56-2b8e20db250e None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:33.429116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de0f67-1389-4d03-8609-a7430b160017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:33.429762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0f67-1389-4d03-8609-a7430b160017 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.430047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0f67-1389-4d03-8609-a7430b160017 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.430324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0f67-1389-4d03-8609-a7430b160017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.495042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de0f67-1389-4d03-8609-a7430b160017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:33.496522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de0f67-1389-4d03-8609-a7430b160017 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:33.499060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:33.591042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 542/1090] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:33.596842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa489ef-b2b8-4c70-be6b-fca7bcbd2e24 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:33.699892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa489ef-b2b8-4c70-be6b-fca7bcbd2e24 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:33.707414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e532-a233-456f-a1f6-84c2743bf6f7 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.707717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e532-a233-456f-a1f6-84c2743bf6f7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.708164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e532-a233-456f-a1f6-84c2743bf6f7 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.709530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 543/1091] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:33.715053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012311d-2f6f-44c5-b465-c636421a5dec None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.715417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012311d-2f6f-44c5-b465-c636421a5dec None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.715867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012311d-2f6f-44c5-b465-c636421a5dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.732557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a012311d-2f6f-44c5-b465-c636421a5dec None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:33.733744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a012311d-2f6f-44c5-b465-c636421a5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:33.734821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c60df-a9ef-495d-92c7-f91e1a0115be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:33.735683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c60df-a9ef-495d-92c7-f91e1a0115be None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.735998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c60df-a9ef-495d-92c7-f91e1a0115be None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.736278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c60df-a9ef-495d-92c7-f91e1a0115be None admin] PATH_INFO: `/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.737457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c60df-a9ef-495d-92c7-f91e1a0115be None admin] RBAC: Authorizing `identity:get_project(project_id=a46a1adaa6da4666b7cb29ac5b16180b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:33.738885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c60df-a9ef-495d-92c7-f91e1a0115be None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:33.740630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 549/1092] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:21:33 2022] GET /identity/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:33.746548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c60df-a9ef-495d-92c7-f91e1a0115be None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:33.800112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 544/1093] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:33.807493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:33.823248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012311d-2f6f-44c5-b465-c636421a5dec None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:33.843774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c60df-a9ef-495d-92c7-f91e1a0115be None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:33.855810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:33.876971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba483a1-ab4d-448d-96ae-19ab11f77bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:33.877613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba483a1-ab4d-448d-96ae-19ab11f77bd3 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.877892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba483a1-ab4d-448d-96ae-19ab11f77bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.878166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba483a1-ab4d-448d-96ae-19ab11f77bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.878977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba483a1-ab4d-448d-96ae-19ab11f77bd3 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=a46a1adaa6da4666b7cb29ac5b16180b, user.id=36c73f145c9a489082242b249ac2aa60) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:33.879290 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba483a1-ab4d-448d-96ae-19ab11f77bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:33.880730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba483a1-ab4d-448d-96ae-19ab11f77bd3 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:33.886784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 550/1094] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:33 2022] GET /identity/v3/role_assignments?user.id=36c73f145c9a489082242b249ac2aa60&scope.project.id=a46a1adaa6da4666b7cb29ac5b16180b&role.id=635caa85d8524fb887206fd521defd3f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:33.923833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012311d-2f6f-44c5-b465-c636421a5dec None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:33.959744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237988-b33d-43fb-9c74-744f5a3fef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:33.960604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237988-b33d-43fb-9c74-744f5a3fef11 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.960889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237988-b33d-43fb-9c74-744f5a3fef11 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.961166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237988-b33d-43fb-9c74-744f5a3fef11 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.973326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237988-b33d-43fb-9c74-744f5a3fef11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-7f237988-b33d-43fb-9c74-744f5a3fef11 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:33.982348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:33.983516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:33.984474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 545/1095] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 16 00:21:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:33.989965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba483a1-ab4d-448d-96ae-19ab11f77bd3 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:34.102055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba483a1-ab4d-448d-96ae-19ab11f77bd3 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:34.127110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:34.135562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619fa4e-0ba6-417d-84b0-37266ec827bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:34.141427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619fa4e-0ba6-417d-84b0-37266ec827bc None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:34.141427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619fa4e-0ba6-417d-84b0-37266ec827bc None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:34.141427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619fa4e-0ba6-417d-84b0-37266ec827bc None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:34.141427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619fa4e-0ba6-417d-84b0-37266ec827bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:34.141427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619fa4e-0ba6-417d-84b0-37266ec827bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:34.141427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619fa4e-0ba6-417d-84b0-37266ec827bc None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:34.147061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 551/1096] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 16 00:21:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:34.153439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237988-b33d-43fb-9c74-744f5a3fef11 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:34.247725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:34.254892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237988-b33d-43fb-9c74-744f5a3fef11 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:34.289617 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925a7bb-b483-46f9-b08d-758a2e78e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:34.290400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925a7bb-b483-46f9-b08d-758a2e78e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:34.290679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925a7bb-b483-46f9-b08d-758a2e78e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:34.290954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925a7bb-b483-46f9-b08d-758a2e78e2f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:34.301829 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925a7bb-b483-46f9-b08d-758a2e78e2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:34.303274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925a7bb-b483-46f9-b08d-758a2e78e2f1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-6925a7bb-b483-46f9-b08d-758a2e78e2f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:34.319566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:34.320447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:34.321477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:34.321477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:34.321477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:34.321477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:34.321477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 546/1097] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:34.326890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619fa4e-0ba6-417d-84b0-37266ec827bc None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:34.424055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619fa4e-0ba6-417d-84b0-37266ec827bc None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:34.458304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e47de-64b9-4f6c-90b5-510a6383332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:34.458959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e47de-64b9-4f6c-90b5-510a6383332a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:34.459240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e47de-64b9-4f6c-90b5-510a6383332a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:34.459516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e47de-64b9-4f6c-90b5-510a6383332a None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:34.460253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e47de-64b9-4f6c-90b5-510a6383332a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:34.460562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e47de-64b9-4f6c-90b5-510a6383332a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:34.461918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e47de-64b9-4f6c-90b5-510a6383332a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:34.473536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 552/1098] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:34.479055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925a7bb-b483-46f9-b08d-758a2e78e2f1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:34.577083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925a7bb-b483-46f9-b08d-758a2e78e2f1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:34.609589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c48b-f6c9-4538-88d7-c8b5557ec332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:34.610376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c48b-f6c9-4538-88d7-c8b5557ec332 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:34.610656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c48b-f6c9-4538-88d7-c8b5557ec332 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:34.610933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c48b-f6c9-4538-88d7-c8b5557ec332 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:34.618435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c48b-f6c9-4538-88d7-c8b5557ec332 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:34.620424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c48b-f6c9-4538-88d7-c8b5557ec332 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-4149c48b-f6c9-4538-88d7-c8b5557ec332 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:21:34.634244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:34.635948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:34.637036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 547/1099] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 16 00:21:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:34.641632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e47de-64b9-4f6c-90b5-510a6383332a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:34.689709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:34.738187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e47de-64b9-4f6c-90b5-510a6383332a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:34.770712 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1cec7-aa93-4304-b259-f6f3d8f6d3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:34.771373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1cec7-aa93-4304-b259-f6f3d8f6d3a9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:34.771650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1cec7-aa93-4304-b259-f6f3d8f6d3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:34.771957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1cec7-aa93-4304-b259-f6f3d8f6d3a9 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:34.772765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1cec7-aa93-4304-b259-f6f3d8f6d3a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:34.773070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1cec7-aa93-4304-b259-f6f3d8f6d3a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:34.774484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1cec7-aa93-4304-b259-f6f3d8f6d3a9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:34.791691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 553/1100] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 16 00:21:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:34.797417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c48b-f6c9-4538-88d7-c8b5557ec332 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:34.806581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:34.895341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c48b-f6c9-4538-88d7-c8b5557ec332 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:34.928720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb128379-25c5-49b9-9c43-d417d27a4ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:34.929365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128379-25c5-49b9-9c43-d417d27a4ac6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:34.929653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128379-25c5-49b9-9c43-d417d27a4ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:34.929934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128379-25c5-49b9-9c43-d417d27a4ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:34.997320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb128379-25c5-49b9-9c43-d417d27a4ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:34.998704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb128379-25c5-49b9-9c43-d417d27a4ac6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:35.006803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:35.100283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 548/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:35.106401 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1cec7-aa93-4304-b259-f6f3d8f6d3a9 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:35.201154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1cec7-aa93-4304-b259-f6f3d8f6d3a9 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:35.209931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:35.233969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664fce-79b7-4487-b4a5-4a614d4cef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:35.234744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664fce-79b7-4487-b4a5-4a614d4cef5e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:35.235023 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664fce-79b7-4487-b4a5-4a614d4cef5e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:35.235403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664fce-79b7-4487-b4a5-4a614d4cef5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:35.245249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664fce-79b7-4487-b4a5-4a614d4cef5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:35.246701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664fce-79b7-4487-b4a5-4a614d4cef5e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-71664fce-79b7-4487-b4a5-4a614d4cef5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:21:35.264136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:35.265175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:35.266286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:21:35.266286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:21:35.266286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:21:35.266286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:35.266286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 554/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:35.270854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb128379-25c5-49b9-9c43-d417d27a4ac6 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:35.369328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb128379-25c5-49b9-9c43-d417d27a4ac6 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:35.376375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:35.402342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c24e-0de4-4072-b1bf-cfe69ec33c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:35.403002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c24e-0de4-4072-b1bf-cfe69ec33c6c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:35.405325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c24e-0de4-4072-b1bf-cfe69ec33c6c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:35.405325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c24e-0de4-4072-b1bf-cfe69ec33c6c None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:35.405325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c24e-0de4-4072-b1bf-cfe69ec33c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:35.405325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c24e-0de4-4072-b1bf-cfe69ec33c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:35.406041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c24e-0de4-4072-b1bf-cfe69ec33c6c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:35.417628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 549/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:35.423171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664fce-79b7-4487-b4a5-4a614d4cef5e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:35.519595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664fce-79b7-4487-b4a5-4a614d4cef5e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:35.553161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b8d82-dc4a-4aed-8b23-8bbb5744d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:35.553952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b8d82-dc4a-4aed-8b23-8bbb5744d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:35.554237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b8d82-dc4a-4aed-8b23-8bbb5744d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:35.554512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b8d82-dc4a-4aed-8b23-8bbb5744d1a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:35.561106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b8d82-dc4a-4aed-8b23-8bbb5744d1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:35.562534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b8d82-dc4a-4aed-8b23-8bbb5744d1a7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-b38b8d82-dc4a-4aed-8b23-8bbb5744d1a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:21:35.576535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:35.577632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:35.583513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:21:35.583513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:21:35.583513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:21:35.583513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:21:35.583513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:21:35.583513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:21:35.583513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:21:35.583513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:35.583513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 555/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:21:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:21:35.584563 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c24e-0de4-4072-b1bf-cfe69ec33c6c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:35.682286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c24e-0de4-4072-b1bf-cfe69ec33c6c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:35.715508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e628175-89aa-43f1-92ee-2482a1005c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:35.716188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e628175-89aa-43f1-92ee-2482a1005c9d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:35.716471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e628175-89aa-43f1-92ee-2482a1005c9d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:35.716748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e628175-89aa-43f1-92ee-2482a1005c9d None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:35.717523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e628175-89aa-43f1-92ee-2482a1005c9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:35.717827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e628175-89aa-43f1-92ee-2482a1005c9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:35.719256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e628175-89aa-43f1-92ee-2482a1005c9d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:35.730914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 550/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:21:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:21:35.736912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b8d82-dc4a-4aed-8b23-8bbb5744d1a7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:35.760360 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:35.836154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b8d82-dc4a-4aed-8b23-8bbb5744d1a7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:35.869195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce44e7-f6a5-44dc-9881-d1633b4a5d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:35.869872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce44e7-f6a5-44dc-9881-d1633b4a5d1a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:35.870149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce44e7-f6a5-44dc-9881-d1633b4a5d1a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:35.870417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce44e7-f6a5-44dc-9881-d1633b4a5d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:35.871239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce44e7-f6a5-44dc-9881-d1633b4a5d1a None admin] RBAC: Adding query filter params (role.id=f67c45ce861841519313d6585e5bd3fe, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=ba29f9c029fe4390af3b6ce1b2147ce9) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:35.871547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce44e7-f6a5-44dc-9881-d1633b4a5d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:35.872997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce44e7-f6a5-44dc-9881-d1633b4a5d1a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:35.878792 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 556/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:35 2022] GET /identity/v3/role_assignments?user.id=ba29f9c029fe4390af3b6ce1b2147ce9&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=f67c45ce861841519313d6585e5bd3fe => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:36.032520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca2347-d215-4212-a211-d01ee8cc4da2 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:36.033036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca2347-d215-4212-a211-d01ee8cc4da2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:36.033185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca2347-d215-4212-a211-d01ee8cc4da2 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:36.034574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 551/1107] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:36.039992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200bc8c-390c-4807-8f81-a2c336cbe3f0 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:36.040288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200bc8c-390c-4807-8f81-a2c336cbe3f0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:36.040574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200bc8c-390c-4807-8f81-a2c336cbe3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:36.058087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f200bc8c-390c-4807-8f81-a2c336cbe3f0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:36.059281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f200bc8c-390c-4807-8f81-a2c336cbe3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:36.127509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 557/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:36.152320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca2347-d215-4212-a211-d01ee8cc4da2 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:36.180705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:36.254550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca2347-d215-4212-a211-d01ee8cc4da2 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:36.289545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b0f67-e5dc-4155-905e-7a22d7a50026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:36.290341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b0f67-e5dc-4155-905e-7a22d7a50026 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:36.290621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b0f67-e5dc-4155-905e-7a22d7a50026 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:36.291423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b0f67-e5dc-4155-905e-7a22d7a50026 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:36.292630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b0f67-e5dc-4155-905e-7a22d7a50026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:36.294083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b0f67-e5dc-4155-905e-7a22d7a50026 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:36.295697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 552/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:36.301631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200bc8c-390c-4807-8f81-a2c336cbe3f0 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:36.317515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:36.405519 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200bc8c-390c-4807-8f81-a2c336cbe3f0 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:36.439671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4700240-3303-4e0b-b99c-338dd768e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:36.440372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4700240-3303-4e0b-b99c-338dd768e438 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:36.440655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4700240-3303-4e0b-b99c-338dd768e438 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:36.440925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4700240-3303-4e0b-b99c-338dd768e438 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:36.441627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4700240-3303-4e0b-b99c-338dd768e438 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:36.443046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4700240-3303-4e0b-b99c-338dd768e438 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:36.538747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 558/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:21:36 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:38.673127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d1ca-3b9e-4dbd-aeb3-69883a8664a9 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:38.673661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d1ca-3b9e-4dbd-aeb3-69883a8664a9 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:38.673661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d1ca-3b9e-4dbd-aeb3-69883a8664a9 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:38.675022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 553/1111] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:38.680321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8b28c-0d79-4682-919e-e499316db2c9 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:38.680727 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8b28c-0d79-4682-919e-e499316db2c9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:38.680960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8b28c-0d79-4682-919e-e499316db2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:38.698252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0ab8b28c-0d79-4682-919e-e499316db2c9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:38.699421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0ab8b28c-0d79-4682-919e-e499316db2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:38.761726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:38.766122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 559/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:38.790104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d1ca-3b9e-4dbd-aeb3-69883a8664a9 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:38.882260 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:38.890136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d1ca-3b9e-4dbd-aeb3-69883a8664a9 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:38.923389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c41e57-8782-4014-ae91-be9bcc903dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:38.924206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41e57-8782-4014-ae91-be9bcc903dac None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:38.924489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41e57-8782-4014-ae91-be9bcc903dac None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:38.924765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41e57-8782-4014-ae91-be9bcc903dac None admin] PATH_INFO: `/v3/roles/19d43474add64d77beb4f1d8b56a2740` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:38.926215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c41e57-8782-4014-ae91-be9bcc903dac None admin] RBAC: Authorizing `identity:get_role(role_id=19d43474add64d77beb4f1d8b56a2740)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:38.927679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c41e57-8782-4014-ae91-be9bcc903dac None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:38.929009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 554/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:38 2022] GET /identity/v3/roles/19d43474add64d77beb4f1d8b56a2740 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:38.935242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8b28c-0d79-4682-919e-e499316db2c9 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:39.030480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8b28c-0d79-4682-919e-e499316db2c9 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:39.105931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cd8a1-1e5b-4ee5-b490-8f3d88daf3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:39.106784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cd8a1-1e5b-4ee5-b490-8f3d88daf3ce None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:39.107065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cd8a1-1e5b-4ee5-b490-8f3d88daf3ce None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:39.107340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cd8a1-1e5b-4ee5-b490-8f3d88daf3ce None admin] PATH_INFO: `/v3/users/2160eba3a413423a973898d3cbb14a73` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:39.120906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cd8a1-1e5b-4ee5-b490-8f3d88daf3ce None admin] RBAC: Authorizing `identity:get_user(user_id=2160eba3a413423a973898d3cbb14a73)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:39.122326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cd8a1-1e5b-4ee5-b490-8f3d88daf3ce None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:39.124440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 560/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:38 2022] GET /identity/v3/users/2160eba3a413423a973898d3cbb14a73 => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:39.130169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c41e57-8782-4014-ae91-be9bcc903dac None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:39.234350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c41e57-8782-4014-ae91-be9bcc903dac None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:39.268705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991f9d9-1e70-4bda-84f9-9ed95a0e995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:39.269347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991f9d9-1e70-4bda-84f9-9ed95a0e995b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:39.269629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991f9d9-1e70-4bda-84f9-9ed95a0e995b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:39.269906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991f9d9-1e70-4bda-84f9-9ed95a0e995b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:39.298318 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:39.334432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991f9d9-1e70-4bda-84f9-9ed95a0e995b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:39.335909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991f9d9-1e70-4bda-84f9-9ed95a0e995b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:39.429456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 555/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:39.436045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cd8a1-1e5b-4ee5-b490-8f3d88daf3ce None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:39.492311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:39.531517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cd8a1-1e5b-4ee5-b490-8f3d88daf3ce None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:39.565814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4aef7a-f59a-4a12-a41a-202346ad55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:39.566647 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4aef7a-f59a-4a12-a41a-202346ad55d9 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:39.566930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4aef7a-f59a-4a12-a41a-202346ad55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:39.567205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4aef7a-f59a-4a12-a41a-202346ad55d9 None admin] PATH_INFO: `/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:39.568377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4aef7a-f59a-4a12-a41a-202346ad55d9 None admin] RBAC: Authorizing `identity:get_project(project_id=a46a1adaa6da4666b7cb29ac5b16180b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:39.569788 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4aef7a-f59a-4a12-a41a-202346ad55d9 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:39.571465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 561/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:21:39 2022] GET /identity/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:39.577642 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991f9d9-1e70-4bda-84f9-9ed95a0e995b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:39.636689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:39.674289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991f9d9-1e70-4bda-84f9-9ed95a0e995b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:39.706997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37248394-9214-4230-9ee3-c235461aa813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:39.707660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248394-9214-4230-9ee3-c235461aa813 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:39.707970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248394-9214-4230-9ee3-c235461aa813 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:39.708245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248394-9214-4230-9ee3-c235461aa813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:39.709055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248394-9214-4230-9ee3-c235461aa813 None admin] RBAC: Adding query filter params (role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=a46a1adaa6da4666b7cb29ac5b16180b, user.id=2160eba3a413423a973898d3cbb14a73) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:39.709362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248394-9214-4230-9ee3-c235461aa813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:39.710788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37248394-9214-4230-9ee3-c235461aa813 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:39.716565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 556/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:39 2022] GET /identity/v3/role_assignments?user.id=2160eba3a413423a973898d3cbb14a73&scope.project.id=a46a1adaa6da4666b7cb29ac5b16180b&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:41.771565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e067ed-5c2c-4d5c-bccc-b925aae5c8cf None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:41.772184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e067ed-5c2c-4d5c-bccc-b925aae5c8cf None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:41.772184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e067ed-5c2c-4d5c-bccc-b925aae5c8cf None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:41.773486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 562/1118] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:41.778693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a00e-81b0-4439-8e8a-c98c4b246983 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:41.779126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a00e-81b0-4439-8e8a-c98c4b246983 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:41.779255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a00e-81b0-4439-8e8a-c98c4b246983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:41.796009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4cd3a00e-81b0-4439-8e8a-c98c4b246983 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:41.797212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4cd3a00e-81b0-4439-8e8a-c98c4b246983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:41.860669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 557/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:41.884079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e067ed-5c2c-4d5c-bccc-b925aae5c8cf None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:41.981394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e067ed-5c2c-4d5c-bccc-b925aae5c8cf None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:42.005067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:42.013417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f035d9b-9410-491c-901c-35908d60ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:42.014248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f035d9b-9410-491c-901c-35908d60ded0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:42.014522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f035d9b-9410-491c-901c-35908d60ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:42.014793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f035d9b-9410-491c-901c-35908d60ded0 None admin] PATH_INFO: `/v3/roles/19d43474add64d77beb4f1d8b56a2740` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:42.016252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f035d9b-9410-491c-901c-35908d60ded0 None admin] RBAC: Authorizing `identity:get_role(role_id=19d43474add64d77beb4f1d8b56a2740)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:42.029046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f035d9b-9410-491c-901c-35908d60ded0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:42.029046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 563/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:41 2022] GET /identity/v3/roles/19d43474add64d77beb4f1d8b56a2740 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:42.029429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a00e-81b0-4439-8e8a-c98c4b246983 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:42.078304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:42.120147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a00e-81b0-4439-8e8a-c98c4b246983 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:42.152750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac527c74-1e56-4ab1-a300-41749378c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:42.153606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac527c74-1e56-4ab1-a300-41749378c611 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:42.153886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac527c74-1e56-4ab1-a300-41749378c611 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:42.154157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac527c74-1e56-4ab1-a300-41749378c611 None admin] PATH_INFO: `/v3/users/2160eba3a413423a973898d3cbb14a73` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:42.155319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac527c74-1e56-4ab1-a300-41749378c611 None admin] RBAC: Authorizing `identity:get_user(user_id=2160eba3a413423a973898d3cbb14a73)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:42.156800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac527c74-1e56-4ab1-a300-41749378c611 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:42.158395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 558/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:42 2022] GET /identity/v3/users/2160eba3a413423a973898d3cbb14a73 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:42.164055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f035d9b-9410-491c-901c-35908d60ded0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:42.260690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f035d9b-9410-491c-901c-35908d60ded0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:42.293810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35045b0c-552e-4a85-8780-8e52820de031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:42.294593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35045b0c-552e-4a85-8780-8e52820de031 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:42.294876 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35045b0c-552e-4a85-8780-8e52820de031 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:42.295154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35045b0c-552e-4a85-8780-8e52820de031 None admin] PATH_INFO: `/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:42.296335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35045b0c-552e-4a85-8780-8e52820de031 None admin] RBAC: Authorizing `identity:get_project(project_id=a46a1adaa6da4666b7cb29ac5b16180b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:42.297761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35045b0c-552e-4a85-8780-8e52820de031 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:42.299434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 564/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:21:42 2022] GET /identity/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:42.305200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac527c74-1e56-4ab1-a300-41749378c611 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:42.400615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac527c74-1e56-4ab1-a300-41749378c611 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:42.422680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:42.432747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a79fc-dc56-4510-8914-c74e6a08580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:42.434285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a79fc-dc56-4510-8914-c74e6a08580b None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:42.434285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a79fc-dc56-4510-8914-c74e6a08580b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:42.434285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a79fc-dc56-4510-8914-c74e6a08580b None admin] PATH_INFO: `/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b/users/2160eba3a413423a973898d3cbb14a73/roles/19d43474add64d77beb4f1d8b56a2740` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:42.436396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a79fc-dc56-4510-8914-c74e6a08580b None admin] RBAC: Authorizing `identity:create_grant(project_id=a46a1adaa6da4666b7cb29ac5b16180b, user_id=2160eba3a413423a973898d3cbb14a73, role_id=19d43474add64d77beb4f1d8b56a2740)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:42.437839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a79fc-dc56-4510-8914-c74e6a08580b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:42.543533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 559/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:21:42 2022] PUT /identity/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b/users/2160eba3a413423a973898d3cbb14a73/roles/19d43474add64d77beb4f1d8b56a2740 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:21:44.609472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc6acc-2016-40f2-91b3-018302acfe57 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:44.610034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc6acc-2016-40f2-91b3-018302acfe57 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:44.610034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc6acc-2016-40f2-91b3-018302acfe57 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:44.611385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 565/1124] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:44.616405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54864ffd-4562-4248-980e-a3ac165bf106 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:44.616795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54864ffd-4562-4248-980e-a3ac165bf106 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:44.616957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54864ffd-4562-4248-980e-a3ac165bf106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:44.633940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-54864ffd-4562-4248-980e-a3ac165bf106 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:44.635602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-54864ffd-4562-4248-980e-a3ac165bf106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:44.699043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 560/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:44.722832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc6acc-2016-40f2-91b3-018302acfe57 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:44.783560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:44.820693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc6acc-2016-40f2-91b3-018302acfe57 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:44.853854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf719886-d100-41e9-81ba-6aa3565ac829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:44.854690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719886-d100-41e9-81ba-6aa3565ac829 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:44.854971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719886-d100-41e9-81ba-6aa3565ac829 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:44.855246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719886-d100-41e9-81ba-6aa3565ac829 None admin] PATH_INFO: `/v3/roles/19d43474add64d77beb4f1d8b56a2740` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:44.856715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf719886-d100-41e9-81ba-6aa3565ac829 None admin] RBAC: Authorizing `identity:get_role(role_id=19d43474add64d77beb4f1d8b56a2740)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:44.858066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf719886-d100-41e9-81ba-6aa3565ac829 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:44.859462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 566/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:44 2022] GET /identity/v3/roles/19d43474add64d77beb4f1d8b56a2740 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:44.865235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54864ffd-4562-4248-980e-a3ac165bf106 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:44.960120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54864ffd-4562-4248-980e-a3ac165bf106 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:44.973317 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:44.992222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14925ba8-d3e9-4f69-b946-68c720073dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:44.993071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925ba8-d3e9-4f69-b946-68c720073dbe None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:44.993348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925ba8-d3e9-4f69-b946-68c720073dbe None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:44.994129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925ba8-d3e9-4f69-b946-68c720073dbe None admin] PATH_INFO: `/v3/users/2160eba3a413423a973898d3cbb14a73` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:44.995284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14925ba8-d3e9-4f69-b946-68c720073dbe None admin] RBAC: Authorizing `identity:get_user(user_id=2160eba3a413423a973898d3cbb14a73)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:44.997018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14925ba8-d3e9-4f69-b946-68c720073dbe None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:44.999415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 561/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:44 2022] GET /identity/v3/users/2160eba3a413423a973898d3cbb14a73 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:45.004214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf719886-d100-41e9-81ba-6aa3565ac829 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:45.099404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf719886-d100-41e9-81ba-6aa3565ac829 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:45.126437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:45.131899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d1bbc-a6e5-4848-b13c-7f3112c0502f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:45.132563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d1bbc-a6e5-4848-b13c-7f3112c0502f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:45.132845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d1bbc-a6e5-4848-b13c-7f3112c0502f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:45.133121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d1bbc-a6e5-4848-b13c-7f3112c0502f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:45.196669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d1bbc-a6e5-4848-b13c-7f3112c0502f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:45.198637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d1bbc-a6e5-4848-b13c-7f3112c0502f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:45.291930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 567/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:45.297948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14925ba8-d3e9-4f69-b946-68c720073dbe None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:45.392573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14925ba8-d3e9-4f69-b946-68c720073dbe None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:45.425323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00733e-c9cb-4206-8c5d-849ec6e6f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:45.426142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00733e-c9cb-4206-8c5d-849ec6e6f4be None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:45.426419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00733e-c9cb-4206-8c5d-849ec6e6f4be None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:45.426687 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00733e-c9cb-4206-8c5d-849ec6e6f4be None admin] PATH_INFO: `/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:45.427856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00733e-c9cb-4206-8c5d-849ec6e6f4be None admin] RBAC: Authorizing `identity:get_project(project_id=a46a1adaa6da4666b7cb29ac5b16180b)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:45.429297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00733e-c9cb-4206-8c5d-849ec6e6f4be None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:45.430927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 562/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:21:45 2022] GET /identity/v3/projects/a46a1adaa6da4666b7cb29ac5b16180b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:45.437147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d1bbc-a6e5-4848-b13c-7f3112c0502f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:45.467294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:45.534690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d1bbc-a6e5-4848-b13c-7f3112c0502f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:45.566714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada841ce-92ad-4452-833f-b5cb4752d5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:45.567346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada841ce-92ad-4452-833f-b5cb4752d5d1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:45.567629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada841ce-92ad-4452-833f-b5cb4752d5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:45.567932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada841ce-92ad-4452-833f-b5cb4752d5d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:45.568753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada841ce-92ad-4452-833f-b5cb4752d5d1 None admin] RBAC: Adding query filter params (role.id=19d43474add64d77beb4f1d8b56a2740, scope.project.id=a46a1adaa6da4666b7cb29ac5b16180b, user.id=2160eba3a413423a973898d3cbb14a73) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:45.569061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada841ce-92ad-4452-833f-b5cb4752d5d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:45.570471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada841ce-92ad-4452-833f-b5cb4752d5d1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:45.576694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 568/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:45 2022] GET /identity/v3/role_assignments?user.id=2160eba3a413423a973898d3cbb14a73&scope.project.id=a46a1adaa6da4666b7cb29ac5b16180b&role.id=19d43474add64d77beb4f1d8b56a2740 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:47.677857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492b35a-7aaf-4d9b-8d97-d3bd3a424fbb None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:47.678402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492b35a-7aaf-4d9b-8d97-d3bd3a424fbb None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:47.678402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492b35a-7aaf-4d9b-8d97-d3bd3a424fbb None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:47.679773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 563/1131] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:47.685383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff7cc-36d8-4409-a852-b0095836a9ad None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:47.685800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff7cc-36d8-4409-a852-b0095836a9ad None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:47.685949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff7cc-36d8-4409-a852-b0095836a9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:47.702198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7afff7cc-36d8-4409-a852-b0095836a9ad None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:47.703383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7afff7cc-36d8-4409-a852-b0095836a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:47.767606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 569/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:47.791147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492b35a-7aaf-4d9b-8d97-d3bd3a424fbb None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:47.840655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:47.889242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492b35a-7aaf-4d9b-8d97-d3bd3a424fbb None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:47.921253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c6e34-555d-43a2-8fe4-2d16e756297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:47.922021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c6e34-555d-43a2-8fe4-2d16e756297d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:47.922300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c6e34-555d-43a2-8fe4-2d16e756297d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:47.922571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c6e34-555d-43a2-8fe4-2d16e756297d None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:47.923717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c6e34-555d-43a2-8fe4-2d16e756297d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:47.925167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c6e34-555d-43a2-8fe4-2d16e756297d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:47.926723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 564/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:47.932942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff7cc-36d8-4409-a852-b0095836a9ad None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:47.957009 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:48.027875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff7cc-36d8-4409-a852-b0095836a9ad None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:48.060418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cc352-6eac-4f2f-96d4-e06f600b0c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:48.061063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cc352-6eac-4f2f-96d4-e06f600b0c4b None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:48.061347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cc352-6eac-4f2f-96d4-e06f600b0c4b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:48.061626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cc352-6eac-4f2f-96d4-e06f600b0c4b None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:48.062317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cc352-6eac-4f2f-96d4-e06f600b0c4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:48.063767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cc352-6eac-4f2f-96d4-e06f600b0c4b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:48.161355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 570/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:21:47 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:50.280886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3fe2-9abc-4c2c-9f55-a1185e2afbe1 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:50.281405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3fe2-9abc-4c2c-9f55-a1185e2afbe1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:50.281496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3fe2-9abc-4c2c-9f55-a1185e2afbe1 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:50.282779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 565/1135] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:50.288000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c232a-e6d6-4d6e-a0b1-1a63fb1fed9b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:50.288382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c232a-e6d6-4d6e-a0b1-1a63fb1fed9b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:50.288565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c232a-e6d6-4d6e-a0b1-1a63fb1fed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:50.305546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-583c232a-e6d6-4d6e-a0b1-1a63fb1fed9b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:50.306654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-583c232a-e6d6-4d6e-a0b1-1a63fb1fed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:50.370122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 571/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:50.394299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3fe2-9abc-4c2c-9f55-a1185e2afbe1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:50.492117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3fe2-9abc-4c2c-9f55-a1185e2afbe1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:50.508732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:50.525099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466ac5d-8384-448f-89ec-fe01920f5e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:50.528944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466ac5d-8384-448f-89ec-fe01920f5e9f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:50.528944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466ac5d-8384-448f-89ec-fe01920f5e9f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:50.528944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466ac5d-8384-448f-89ec-fe01920f5e9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:50.528944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466ac5d-8384-448f-89ec-fe01920f5e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:50.529282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466ac5d-8384-448f-89ec-fe01920f5e9f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:50.530662 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 566/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:21:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:50.536206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c232a-e6d6-4d6e-a0b1-1a63fb1fed9b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:50.544703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:50.633791 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c232a-e6d6-4d6e-a0b1-1a63fb1fed9b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:50.666613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e291d07-da86-461b-a8f0-ce509c3dd4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:50.667270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e291d07-da86-461b-a8f0-ce509c3dd4b4 None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:50.667553 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e291d07-da86-461b-a8f0-ce509c3dd4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:50.667862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e291d07-da86-461b-a8f0-ce509c3dd4b4 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:50.668559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e291d07-da86-461b-a8f0-ce509c3dd4b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:50.669986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e291d07-da86-461b-a8f0-ce509c3dd4b4 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:50.739693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 572/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:21:50 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:52.884144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e94e7-c097-45ec-9330-02f0641349c3 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:52.884699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e94e7-c097-45ec-9330-02f0641349c3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:52.884699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e94e7-c097-45ec-9330-02f0641349c3 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:52.886075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 567/1139] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:52.891460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d76bd-ddc4-4897-bd12-8ec92c27ea69 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:52.891880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d76bd-ddc4-4897-bd12-8ec92c27ea69 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:52.892032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d76bd-ddc4-4897-bd12-8ec92c27ea69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:52.908198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-678d76bd-ddc4-4897-bd12-8ec92c27ea69 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:52.909358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-678d76bd-ddc4-4897-bd12-8ec92c27ea69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:52.963525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:52.973349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 573/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:21:52.998050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e94e7-c097-45ec-9330-02f0641349c3 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:53.096601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e94e7-c097-45ec-9330-02f0641349c3 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:53.129670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d149b3-51f2-4067-8754-29d9501a87ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:53.130443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d149b3-51f2-4067-8754-29d9501a87ae None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:53.130725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d149b3-51f2-4067-8754-29d9501a87ae None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:53.130998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d149b3-51f2-4067-8754-29d9501a87ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:53.141115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d149b3-51f2-4067-8754-29d9501a87ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-d7d149b3-51f2-4067-8754-29d9501a87ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:53.148611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:53.150076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:53.151034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 568/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:21:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:53.156251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d76bd-ddc4-4897-bd12-8ec92c27ea69 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:53.250379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d76bd-ddc4-4897-bd12-8ec92c27ea69 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:53.282492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e652a-ea48-445a-9348-b7c3f08559d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:53.283135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e652a-ea48-445a-9348-b7c3f08559d0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:53.283414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e652a-ea48-445a-9348-b7c3f08559d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:53.283685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e652a-ea48-445a-9348-b7c3f08559d0 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:53.284553 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e652a-ea48-445a-9348-b7c3f08559d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:53.284856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e652a-ea48-445a-9348-b7c3f08559d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:53.286201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e652a-ea48-445a-9348-b7c3f08559d0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:53.294478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 574/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:21:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:53.300122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d149b3-51f2-4067-8754-29d9501a87ae None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:53.345049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:53.396380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d149b3-51f2-4067-8754-29d9501a87ae None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:53.428265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae314-e7ee-4b18-9831-9bf622c4904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:53.429111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae314-e7ee-4b18-9831-9bf622c4904f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:53.429388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae314-e7ee-4b18-9831-9bf622c4904f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:53.429661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae314-e7ee-4b18-9831-9bf622c4904f None admin] PATH_INFO: `/v3/users/81d438ca37284a4ab7d85b99ced28e05` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:53.442582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae314-e7ee-4b18-9831-9bf622c4904f None admin] RBAC: Authorizing `identity:get_user(user_id=81d438ca37284a4ab7d85b99ced28e05)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:53.444049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae314-e7ee-4b18-9831-9bf622c4904f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:53.445648 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 569/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:53 2022] GET /identity/v3/users/81d438ca37284a4ab7d85b99ced28e05 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:53.451899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e652a-ea48-445a-9348-b7c3f08559d0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:53.504144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:53.547289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e652a-ea48-445a-9348-b7c3f08559d0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:53.579082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292f560-4dc1-4a73-8202-94df174f4b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:53.579718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292f560-4dc1-4a73-8202-94df174f4b8d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:53.580029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292f560-4dc1-4a73-8202-94df174f4b8d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:53.580306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292f560-4dc1-4a73-8202-94df174f4b8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:53.643953 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292f560-4dc1-4a73-8202-94df174f4b8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:53.645384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292f560-4dc1-4a73-8202-94df174f4b8d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:53.696053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:53.738733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 575/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:53.745131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae314-e7ee-4b18-9831-9bf622c4904f None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:53.838650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae314-e7ee-4b18-9831-9bf622c4904f None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:53.840897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:53.871146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb4c6b-0413-4ba3-ac5c-7b157a67c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:53.872110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb4c6b-0413-4ba3-ac5c-7b157a67c64f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:53.872396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb4c6b-0413-4ba3-ac5c-7b157a67c64f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:53.872669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb4c6b-0413-4ba3-ac5c-7b157a67c64f None admin] PATH_INFO: `/v3/projects/21fdeb48052c4061b67a6967b7ddbf3a` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:53.873818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb4c6b-0413-4ba3-ac5c-7b157a67c64f None admin] RBAC: Authorizing `identity:get_project(project_id=21fdeb48052c4061b67a6967b7ddbf3a)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:53.875281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb4c6b-0413-4ba3-ac5c-7b157a67c64f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:53.877402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 570/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:21:53 2022] GET /identity/v3/projects/21fdeb48052c4061b67a6967b7ddbf3a => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:53.883283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292f560-4dc1-4a73-8202-94df174f4b8d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:53.980938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292f560-4dc1-4a73-8202-94df174f4b8d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:54.015725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bbc2d-201a-4bdd-bd85-b326a7ffa5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:54.016379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bbc2d-201a-4bdd-bd85-b326a7ffa5b5 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:54.016659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bbc2d-201a-4bdd-bd85-b326a7ffa5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:54.016929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bbc2d-201a-4bdd-bd85-b326a7ffa5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:54.017731 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bbc2d-201a-4bdd-bd85-b326a7ffa5b5 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=21fdeb48052c4061b67a6967b7ddbf3a, user.id=81d438ca37284a4ab7d85b99ced28e05) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:54.018036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bbc2d-201a-4bdd-bd85-b326a7ffa5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:54.019535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bbc2d-201a-4bdd-bd85-b326a7ffa5b5 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:54.026057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 576/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:21:53 2022] GET /identity/v3/role_assignments?user.id=81d438ca37284a4ab7d85b99ced28e05&scope.project.id=21fdeb48052c4061b67a6967b7ddbf3a&role.id=635caa85d8524fb887206fd521defd3f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:56.086229 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39250633-b8e2-49c2-9364-a29b69cc380c None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:56.086730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39250633-b8e2-49c2-9364-a29b69cc380c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:56.086816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39250633-b8e2-49c2-9364-a29b69cc380c None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:56.088179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 571/1147] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:56.093169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ce6c-ee0c-4559-a607-038492644966 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:56.093573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ce6c-ee0c-4559-a607-038492644966 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:56.093724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870ce6c-ee0c-4559-a607-038492644966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:56.110437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0870ce6c-ee0c-4559-a607-038492644966 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:56.111614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0870ce6c-ee0c-4559-a607-038492644966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:56.127434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:56.179435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 577/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:56.201094 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39250633-b8e2-49c2-9364-a29b69cc380c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:56.298375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39250633-b8e2-49c2-9364-a29b69cc380c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:56.329877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751a6d9-146f-4f56-8b2e-36c128161ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:56.330640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751a6d9-146f-4f56-8b2e-36c128161ed1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:56.330919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751a6d9-146f-4f56-8b2e-36c128161ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:56.331190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751a6d9-146f-4f56-8b2e-36c128161ed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:56.341360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751a6d9-146f-4f56-8b2e-36c128161ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-0751a6d9-146f-4f56-8b2e-36c128161ed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:56.348808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:56.349880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:21:56.351106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 572/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:56.356422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870ce6c-ee0c-4559-a607-038492644966 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:56.450105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870ce6c-ee0c-4559-a607-038492644966 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:56.483894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e255b-391b-4f55-b5ce-a15f1c2066bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:56.484550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e255b-391b-4f55-b5ce-a15f1c2066bb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:56.484834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e255b-391b-4f55-b5ce-a15f1c2066bb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:56.485112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e255b-391b-4f55-b5ce-a15f1c2066bb None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:56.485846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e255b-391b-4f55-b5ce-a15f1c2066bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:56.486154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e255b-391b-4f55-b5ce-a15f1c2066bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:56.487515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e255b-391b-4f55-b5ce-a15f1c2066bb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:56.495289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 578/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:21:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:56.500996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751a6d9-146f-4f56-8b2e-36c128161ed1 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:56.532190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:56.597548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751a6d9-146f-4f56-8b2e-36c128161ed1 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:56.630095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c761dd-613d-466c-abcd-525716e554fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:56.630229 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c761dd-613d-466c-abcd-525716e554fd None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:56.630461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c761dd-613d-466c-abcd-525716e554fd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:56.630733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c761dd-613d-466c-abcd-525716e554fd None admin] PATH_INFO: `/v3/users/81d438ca37284a4ab7d85b99ced28e05` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:56.632177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c761dd-613d-466c-abcd-525716e554fd None admin] RBAC: Authorizing `identity:get_user(user_id=81d438ca37284a4ab7d85b99ced28e05)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:56.633601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c761dd-613d-466c-abcd-525716e554fd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:56.635696 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 573/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:56 2022] GET /identity/v3/users/81d438ca37284a4ab7d85b99ced28e05 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:56.641216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e255b-391b-4f55-b5ce-a15f1c2066bb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:56.654134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:56.737126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e255b-391b-4f55-b5ce-a15f1c2066bb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:56.768854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b9c9-1412-465d-8564-d3f0fb26d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:56.769691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b9c9-1412-465d-8564-d3f0fb26d933 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:56.769971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b9c9-1412-465d-8564-d3f0fb26d933 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:56.770241 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b9c9-1412-465d-8564-d3f0fb26d933 None admin] PATH_INFO: `/v3/projects/21fdeb48052c4061b67a6967b7ddbf3a` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:56.771379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b9c9-1412-465d-8564-d3f0fb26d933 None admin] RBAC: Authorizing `identity:get_project(project_id=21fdeb48052c4061b67a6967b7ddbf3a)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:56.772807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b9c9-1412-465d-8564-d3f0fb26d933 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:56.775080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 579/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:21:56 2022] GET /identity/v3/projects/21fdeb48052c4061b67a6967b7ddbf3a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:56.780700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c761dd-613d-466c-abcd-525716e554fd None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:56.874319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:56.877055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c761dd-613d-466c-abcd-525716e554fd None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:56.910482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c22c15-21c6-4116-a878-0de9fe5c2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:56.911347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c22c15-21c6-4116-a878-0de9fe5c2e3b None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:56.911623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c22c15-21c6-4116-a878-0de9fe5c2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:56.911924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c22c15-21c6-4116-a878-0de9fe5c2e3b None admin] PATH_INFO: `/v3/projects/21fdeb48052c4061b67a6967b7ddbf3a/users/81d438ca37284a4ab7d85b99ced28e05/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:56.913822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c22c15-21c6-4116-a878-0de9fe5c2e3b None admin] RBAC: Authorizing `identity:create_grant(project_id=21fdeb48052c4061b67a6967b7ddbf3a, user_id=81d438ca37284a4ab7d85b99ced28e05, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:56.915250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c22c15-21c6-4116-a878-0de9fe5c2e3b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:56.984756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 574/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:21:56 2022] PUT /identity/v3/projects/21fdeb48052c4061b67a6967b7ddbf3a/users/81d438ca37284a4ab7d85b99ced28e05/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:21:59.063376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ceb13-dec5-4e3b-b188-3e870dbd9ee5 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:59.063856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ceb13-dec5-4e3b-b188-3e870dbd9ee5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:59.063946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ceb13-dec5-4e3b-b188-3e870dbd9ee5 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:59.065313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 580/1154] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:59.070447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03dc0d-2d67-47c4-8a1c-22d8a69cffcd None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:59.070849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03dc0d-2d67-47c4-8a1c-22d8a69cffcd None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:59.071519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03dc0d-2d67-47c4-8a1c-22d8a69cffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:59.088507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-dd03dc0d-2d67-47c4-8a1c-22d8a69cffcd None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:59.089687 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dd03dc0d-2d67-47c4-8a1c-22d8a69cffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:59.154148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 575/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:21:59.177276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ceb13-dec5-4e3b-b188-3e870dbd9ee5 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:59.253655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:59.275516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ceb13-dec5-4e3b-b188-3e870dbd9ee5 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:59.307692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b6674-cdb4-4697-a028-e03940af6e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:59.308432 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6674-cdb4-4697-a028-e03940af6e8b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:59.308714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6674-cdb4-4697-a028-e03940af6e8b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:59.308989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b6674-cdb4-4697-a028-e03940af6e8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:59.318626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b6674-cdb4-4697-a028-e03940af6e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-c29b6674-cdb4-4697-a028-e03940af6e8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:21:59.326706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:21:59.327808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:21:59.328704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 581/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:21:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:21:59.333766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03dc0d-2d67-47c4-8a1c-22d8a69cffcd None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:59.417559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:59.426492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03dc0d-2d67-47c4-8a1c-22d8a69cffcd None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:59.459749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498657f-ad7a-4f50-be51-c3233bb16a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:59.460411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498657f-ad7a-4f50-be51-c3233bb16a33 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:59.460689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498657f-ad7a-4f50-be51-c3233bb16a33 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:59.460963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498657f-ad7a-4f50-be51-c3233bb16a33 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:59.461716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498657f-ad7a-4f50-be51-c3233bb16a33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:59.462021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498657f-ad7a-4f50-be51-c3233bb16a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:59.463384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498657f-ad7a-4f50-be51-c3233bb16a33 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:59.470990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 576/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:21:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:59.476736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b6674-cdb4-4697-a028-e03940af6e8b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:59.572887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b6674-cdb4-4697-a028-e03940af6e8b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:59.604643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600478e6-756b-47b9-bdcd-889128ffc792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:59.605488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600478e6-756b-47b9-bdcd-889128ffc792 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:59.605764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600478e6-756b-47b9-bdcd-889128ffc792 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:59.606032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600478e6-756b-47b9-bdcd-889128ffc792 None admin] PATH_INFO: `/v3/users/81d438ca37284a4ab7d85b99ced28e05` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:59.607188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600478e6-756b-47b9-bdcd-889128ffc792 None admin] RBAC: Authorizing `identity:get_user(user_id=81d438ca37284a4ab7d85b99ced28e05)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:59.608637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600478e6-756b-47b9-bdcd-889128ffc792 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:59.610233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 582/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:21:59 2022] GET /identity/v3/users/81d438ca37284a4ab7d85b99ced28e05 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:59.615758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498657f-ad7a-4f50-be51-c3233bb16a33 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:59.716704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498657f-ad7a-4f50-be51-c3233bb16a33 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:59.749670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdb074-d867-46de-a56a-f0d6e2d5633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:59.750307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdb074-d867-46de-a56a-f0d6e2d5633d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:59.750593 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdb074-d867-46de-a56a-f0d6e2d5633d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:59.750874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdb074-d867-46de-a56a-f0d6e2d5633d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:59.771941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:59.815785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdb074-d867-46de-a56a-f0d6e2d5633d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:59.817236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdb074-d867-46de-a56a-f0d6e2d5633d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:59.912100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 577/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:21:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:21:59.918484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600478e6-756b-47b9-bdcd-889128ffc792 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:59.927666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:00.013729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600478e6-756b-47b9-bdcd-889128ffc792 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:00.046281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d1bdc-40dd-4226-a3ad-667f92203bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:00.047128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d1bdc-40dd-4226-a3ad-667f92203bf0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:00.047407 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d1bdc-40dd-4226-a3ad-667f92203bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:00.047677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d1bdc-40dd-4226-a3ad-667f92203bf0 None admin] PATH_INFO: `/v3/projects/21fdeb48052c4061b67a6967b7ddbf3a` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:00.048854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d1bdc-40dd-4226-a3ad-667f92203bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=21fdeb48052c4061b67a6967b7ddbf3a)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:00.050271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d1bdc-40dd-4226-a3ad-667f92203bf0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:00.051970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 583/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:21:59 2022] GET /identity/v3/projects/21fdeb48052c4061b67a6967b7ddbf3a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:00.058006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdb074-d867-46de-a56a-f0d6e2d5633d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:00.108535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:00.153161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdb074-d867-46de-a56a-f0d6e2d5633d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:00.185869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb901c9-4cd6-4d59-afa4-e812e5b8ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:00.186461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb901c9-4cd6-4d59-afa4-e812e5b8ef64 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:00.186746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb901c9-4cd6-4d59-afa4-e812e5b8ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:00.187022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb901c9-4cd6-4d59-afa4-e812e5b8ef64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:00.187863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb901c9-4cd6-4d59-afa4-e812e5b8ef64 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=21fdeb48052c4061b67a6967b7ddbf3a, user.id=81d438ca37284a4ab7d85b99ced28e05) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:22:00.188176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb901c9-4cd6-4d59-afa4-e812e5b8ef64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:00.189595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb901c9-4cd6-4d59-afa4-e812e5b8ef64 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:00.195227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 578/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:22:00 2022] GET /identity/v3/role_assignments?user.id=81d438ca37284a4ab7d85b99ced28e05&scope.project.id=21fdeb48052c4061b67a6967b7ddbf3a&role.id=635caa85d8524fb887206fd521defd3f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:02.283877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda82825-01b7-4291-beca-d56da63921bb None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:02.284411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda82825-01b7-4291-beca-d56da63921bb None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:02.284411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda82825-01b7-4291-beca-d56da63921bb None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:02.285779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 584/1162] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:02.290860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2fd1-db1f-4df7-b884-a07e40e27b5c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:02.291267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2fd1-db1f-4df7-b884-a07e40e27b5c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:02.291369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2fd1-db1f-4df7-b884-a07e40e27b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:02.308123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-287e2fd1-db1f-4df7-b884-a07e40e27b5c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:02.309287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-287e2fd1-db1f-4df7-b884-a07e40e27b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:02.372946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 579/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:22:02.395751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda82825-01b7-4291-beca-d56da63921bb None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:02.468577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:02.492465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda82825-01b7-4291-beca-d56da63921bb None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:02.525509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f24d5-6d81-408a-9553-ae267451c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:02.526142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f24d5-6d81-408a-9553-ae267451c8fa None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:02.526427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f24d5-6d81-408a-9553-ae267451c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:02.526704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f24d5-6d81-408a-9553-ae267451c8fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:02.590480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f24d5-6d81-408a-9553-ae267451c8fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:02.591955 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f24d5-6d81-408a-9553-ae267451c8fa None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:02.661748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:02.687710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 585/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:22:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:22:02.693667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e2fd1-db1f-4df7-b884-a07e40e27b5c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:02.738183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:02.790155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e2fd1-db1f-4df7-b884-a07e40e27b5c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:02.823144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af109-20d1-4886-9f71-08c2c870201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:02.823957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af109-20d1-4886-9f71-08c2c870201f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:02.824243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af109-20d1-4886-9f71-08c2c870201f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:02.824524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af109-20d1-4886-9f71-08c2c870201f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:02.831034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0af109-20d1-4886-9f71-08c2c870201f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:02.832510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0af109-20d1-4886-9f71-08c2c870201f None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-0d0af109-20d1-4886-9f71-08c2c870201f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:22:02.846396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:22:02.847552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 00:22:02.848621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:22:02.851877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 580/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:22:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:22:02.853735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f24d5-6d81-408a-9553-ae267451c8fa None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:02.946956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f24d5-6d81-408a-9553-ae267451c8fa None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:02.980031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99607a2e-4e4f-4f31-afab-69fec5704444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:02.980684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99607a2e-4e4f-4f31-afab-69fec5704444 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:02.980971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99607a2e-4e4f-4f31-afab-69fec5704444 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:02.981251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99607a2e-4e4f-4f31-afab-69fec5704444 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:02.981964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99607a2e-4e4f-4f31-afab-69fec5704444 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:22:02.982274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99607a2e-4e4f-4f31-afab-69fec5704444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:02.983625 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99607a2e-4e4f-4f31-afab-69fec5704444 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:02.990583 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 586/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 16 00:22:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:05.078439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e4925-eb67-4746-8a66-8b3942185e0b None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:05.078877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e4925-eb67-4746-8a66-8b3942185e0b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:05.078995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e4925-eb67-4746-8a66-8b3942185e0b None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:05.080388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 581/1167] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:05.085377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e320b22-1284-429d-a7f5-3fc56a2733f5 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:05.085791 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e320b22-1284-429d-a7f5-3fc56a2733f5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:05.085947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e320b22-1284-429d-a7f5-3fc56a2733f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:05.102898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8e320b22-1284-429d-a7f5-3fc56a2733f5 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:05.104109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8e320b22-1284-429d-a7f5-3fc56a2733f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:05.132481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:05.168798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 587/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:22:05.191532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e4925-eb67-4746-8a66-8b3942185e0b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:05.288497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e4925-eb67-4746-8a66-8b3942185e0b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:05.295239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:05.321885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e49b3-39da-4efc-9d53-011beb392e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:05.322530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e49b3-39da-4efc-9d53-011beb392e55 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:05.322812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e49b3-39da-4efc-9d53-011beb392e55 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:05.323084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e49b3-39da-4efc-9d53-011beb392e55 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:05.323850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e49b3-39da-4efc-9d53-011beb392e55 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:05.325216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e49b3-39da-4efc-9d53-011beb392e55 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:05.395388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 582/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Thu Jun 16 00:22:05 2022] POST /identity/v3/domains => generated 267 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:22:07.502635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903142-9956-4dad-96fa-7c901a1255ef None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:07.503160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903142-9956-4dad-96fa-7c901a1255ef None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:07.503160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903142-9956-4dad-96fa-7c901a1255ef None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:07.504581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 588/1170] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:07.510068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195030-5c5b-4bb1-a2d8-32e45ec9091b None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:07.510461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195030-5c5b-4bb1-a2d8-32e45ec9091b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:07.510631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195030-5c5b-4bb1-a2d8-32e45ec9091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:07.528027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-08195030-5c5b-4bb1-a2d8-32e45ec9091b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:07.529201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-08195030-5c5b-4bb1-a2d8-32e45ec9091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:07.592781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 583/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:22:07.616330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903142-9956-4dad-96fa-7c901a1255ef None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:07.713237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903142-9956-4dad-96fa-7c901a1255ef None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:07.745574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ef89f-cc8c-402c-84ab-85dd42c2b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:07.746460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef89f-cc8c-402c-84ab-85dd42c2b52c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:07.746746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef89f-cc8c-402c-84ab-85dd42c2b52c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:07.747023 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef89f-cc8c-402c-84ab-85dd42c2b52c None admin] PATH_INFO: `/v3/domains/91252f0105004998b8fb797fed843947` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:07.757437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ef89f-cc8c-402c-84ab-85dd42c2b52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=91252f0105004998b8fb797fed843947)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:07.758838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ef89f-cc8c-402c-84ab-85dd42c2b52c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:07.760483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 589/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Jun 16 00:22:07 2022] GET /identity/v3/domains/91252f0105004998b8fb797fed843947 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:07.766111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195030-5c5b-4bb1-a2d8-32e45ec9091b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:07.856361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:07.861918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195030-5c5b-4bb1-a2d8-32e45ec9091b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:07.894981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eef50-9d00-4f59-a872-e5e188e64bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:07.895623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eef50-9d00-4f59-a872-e5e188e64bfd None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:07.895926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eef50-9d00-4f59-a872-e5e188e64bfd None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:07.896205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eef50-9d00-4f59-a872-e5e188e64bfd None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:07.896902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eef50-9d00-4f59-a872-e5e188e64bfd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:07.898387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eef50-9d00-4f59-a872-e5e188e64bfd None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:08.014873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 584/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:22:07 2022] POST /identity/v3/projects => generated 361 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:22:10.118848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f715b8-7045-4aa8-aafe-1b3ae3f30388 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:10.119357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f715b8-7045-4aa8-aafe-1b3ae3f30388 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:10.119477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f715b8-7045-4aa8-aafe-1b3ae3f30388 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:10.120809 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 590/1174] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:10.126005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aede64-a163-4cbc-9b16-e33dc2de5564 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:10.126403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aede64-a163-4cbc-9b16-e33dc2de5564 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:10.126571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aede64-a163-4cbc-9b16-e33dc2de5564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:10.143209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e2aede64-a163-4cbc-9b16-e33dc2de5564 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:10.144433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e2aede64-a163-4cbc-9b16-e33dc2de5564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:10.208785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 585/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:22:10.233574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f715b8-7045-4aa8-aafe-1b3ae3f30388 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:10.262028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:10.332199 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f715b8-7045-4aa8-aafe-1b3ae3f30388 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:10.364197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192703f-9270-421a-8994-8de338cd10f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:10.365045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192703f-9270-421a-8994-8de338cd10f1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:10.365330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192703f-9270-421a-8994-8de338cd10f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:10.365608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192703f-9270-421a-8994-8de338cd10f1 None admin] PATH_INFO: `/v3/domains/91252f0105004998b8fb797fed843947` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:10.366772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192703f-9270-421a-8994-8de338cd10f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=91252f0105004998b8fb797fed843947)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:10.368830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192703f-9270-421a-8994-8de338cd10f1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:10.370434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 591/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Jun 16 00:22:10 2022] GET /identity/v3/domains/91252f0105004998b8fb797fed843947 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:10.376113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aede64-a163-4cbc-9b16-e33dc2de5564 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:10.450717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:10.471300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aede64-a163-4cbc-9b16-e33dc2de5564 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:10.504210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acb87b-bdfb-4c5a-ac9b-e7d96a9a960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:10.505083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acb87b-bdfb-4c5a-ac9b-e7d96a9a960a None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:10.505549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acb87b-bdfb-4c5a-ac9b-e7d96a9a960a None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:10.506225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acb87b-bdfb-4c5a-ac9b-e7d96a9a960a None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:10.507187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acb87b-bdfb-4c5a-ac9b-e7d96a9a960a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:10.508693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acb87b-bdfb-4c5a-ac9b-e7d96a9a960a None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:10.578741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 586/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:22:10 2022] POST /identity/v3/users => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:22:12.716587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c4e4-ad94-4b17-9c6e-ffaf8b111092 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:12.717144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c4e4-ad94-4b17-9c6e-ffaf8b111092 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:12.717144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c4e4-ad94-4b17-9c6e-ffaf8b111092 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:12.718494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 592/1178] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:12.723748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19cccf-dc1a-4f90-abb2-d0edafad433c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:12.724143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19cccf-dc1a-4f90-abb2-d0edafad433c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:12.724315 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19cccf-dc1a-4f90-abb2-d0edafad433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:12.740662 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7b19cccf-dc1a-4f90-abb2-d0edafad433c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:12.741879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7b19cccf-dc1a-4f90-abb2-d0edafad433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:12.808924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 587/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:22:12.832884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c4e4-ad94-4b17-9c6e-ffaf8b111092 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:12.923366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:12.929669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c4e4-ad94-4b17-9c6e-ffaf8b111092 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:12.963019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8fd0-f964-4976-b024-3a270b76d337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:12.963807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8fd0-f964-4976-b024-3a270b76d337 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:12.964089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8fd0-f964-4976-b024-3a270b76d337 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:12.964359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8fd0-f964-4976-b024-3a270b76d337 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:12.973998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab8fd0-f964-4976-b024-3a270b76d337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-eeab8fd0-f964-4976-b024-3a270b76d337 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:22:12.981370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:22:12.982471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:22:12.983753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 593/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:22:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:22:12.988529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19cccf-dc1a-4f90-abb2-d0edafad433c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:13.049121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:13.084976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19cccf-dc1a-4f90-abb2-d0edafad433c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:13.118247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71c114-e3cb-46b8-b226-4e91d3fe73c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:13.118894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71c114-e3cb-46b8-b226-4e91d3fe73c9 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:13.119174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71c114-e3cb-46b8-b226-4e91d3fe73c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:13.119446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71c114-e3cb-46b8-b226-4e91d3fe73c9 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:13.120203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71c114-e3cb-46b8-b226-4e91d3fe73c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:22:13.120521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71c114-e3cb-46b8-b226-4e91d3fe73c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:13.121868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71c114-e3cb-46b8-b226-4e91d3fe73c9 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:13.129545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 588/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:22:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:13.135636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8fd0-f964-4976-b024-3a270b76d337 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:13.230353 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8fd0-f964-4976-b024-3a270b76d337 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:13.262067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b823da9-9832-4497-a4e7-9dc2b6ef161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:13.262908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b823da9-9832-4497-a4e7-9dc2b6ef161c None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:13.263187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b823da9-9832-4497-a4e7-9dc2b6ef161c None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:13.263459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b823da9-9832-4497-a4e7-9dc2b6ef161c None admin] PATH_INFO: `/v3/users/40c941be9f5c4b0d862f0404b30d6b7a` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:13.276040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b823da9-9832-4497-a4e7-9dc2b6ef161c None admin] RBAC: Authorizing `identity:get_user(user_id=40c941be9f5c4b0d862f0404b30d6b7a)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:13.277454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b823da9-9832-4497-a4e7-9dc2b6ef161c None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:13.279046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 594/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:22:13 2022] GET /identity/v3/users/40c941be9f5c4b0d862f0404b30d6b7a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:13.284576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71c114-e3cb-46b8-b226-4e91d3fe73c9 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:13.381237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71c114-e3cb-46b8-b226-4e91d3fe73c9 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:13.405664 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:13.413837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b6ecf-bea7-4749-a98d-82194a6d201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:13.423773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6ecf-bea7-4749-a98d-82194a6d201b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:13.423773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6ecf-bea7-4749-a98d-82194a6d201b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:13.423773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6ecf-bea7-4749-a98d-82194a6d201b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:13.479518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b6ecf-bea7-4749-a98d-82194a6d201b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:13.481039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b6ecf-bea7-4749-a98d-82194a6d201b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:13.573937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 589/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:22:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:22:13.579693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b823da9-9832-4497-a4e7-9dc2b6ef161c None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:13.595076 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:13.675172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b823da9-9832-4497-a4e7-9dc2b6ef161c None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:13.706606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5cf7c-b2c4-4573-99f5-e23c8fb42ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:13.707431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5cf7c-b2c4-4573-99f5-e23c8fb42ba0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:13.707708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5cf7c-b2c4-4573-99f5-e23c8fb42ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:13.708004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5cf7c-b2c4-4573-99f5-e23c8fb42ba0 None admin] PATH_INFO: `/v3/projects/0af724979c4446e7a44736c2401a519b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:13.709148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5cf7c-b2c4-4573-99f5-e23c8fb42ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=0af724979c4446e7a44736c2401a519b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:13.710566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5cf7c-b2c4-4573-99f5-e23c8fb42ba0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:13.712786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 595/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:22:13 2022] GET /identity/v3/projects/0af724979c4446e7a44736c2401a519b => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:13.718847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b6ecf-bea7-4749-a98d-82194a6d201b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:13.745044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:13.814079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b6ecf-bea7-4749-a98d-82194a6d201b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:13.847774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6bc11-3c25-46fd-b5f1-1585a52d9926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:13.848419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6bc11-3c25-46fd-b5f1-1585a52d9926 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:13.848703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6bc11-3c25-46fd-b5f1-1585a52d9926 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:13.848980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6bc11-3c25-46fd-b5f1-1585a52d9926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:13.849803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6bc11-3c25-46fd-b5f1-1585a52d9926 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=0af724979c4446e7a44736c2401a519b, user.id=40c941be9f5c4b0d862f0404b30d6b7a) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:22:13.850114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6bc11-3c25-46fd-b5f1-1585a52d9926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:13.851549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6bc11-3c25-46fd-b5f1-1585a52d9926 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:13.856855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 590/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:22:13 2022] GET /identity/v3/role_assignments?user.id=40c941be9f5c4b0d862f0404b30d6b7a&scope.project.id=0af724979c4446e7a44736c2401a519b&role.id=635caa85d8524fb887206fd521defd3f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:15.909521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364971-1929-4f14-8b53-2e5b6f617da6 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:15.910042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364971-1929-4f14-8b53-2e5b6f617da6 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:15.910042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364971-1929-4f14-8b53-2e5b6f617da6 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:15.911408 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 596/1186] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:15.916616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5d55f-027c-4f95-9123-33ad9976acb3 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:15.917249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5d55f-027c-4f95-9123-33ad9976acb3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:15.917249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5d55f-027c-4f95-9123-33ad9976acb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:15.934160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-6ed5d55f-027c-4f95-9123-33ad9976acb3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:15.935338 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-6ed5d55f-027c-4f95-9123-33ad9976acb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:15.998917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 591/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:22:16.021605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac364971-1929-4f14-8b53-2e5b6f617da6 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:16.100501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:16.119356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac364971-1929-4f14-8b53-2e5b6f617da6 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:16.151584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225cbbd-d291-465a-aaf3-7cb7cb9ec991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:16.152379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225cbbd-d291-465a-aaf3-7cb7cb9ec991 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:16.152660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225cbbd-d291-465a-aaf3-7cb7cb9ec991 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:16.152933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225cbbd-d291-465a-aaf3-7cb7cb9ec991 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:16.162912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225cbbd-d291-465a-aaf3-7cb7cb9ec991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e225cbbd-d291-465a-aaf3-7cb7cb9ec991 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:22:16.170844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:22:16.172138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:22:16.173317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 597/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:22:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:22:16.178302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5d55f-027c-4f95-9123-33ad9976acb3 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:16.199676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:16.273517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5d55f-027c-4f95-9123-33ad9976acb3 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:16.306503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7470e-6f56-48ea-8c54-e67c8374f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:16.307147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7470e-6f56-48ea-8c54-e67c8374f06b None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:16.307429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7470e-6f56-48ea-8c54-e67c8374f06b None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:16.307708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7470e-6f56-48ea-8c54-e67c8374f06b None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:16.308468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7470e-6f56-48ea-8c54-e67c8374f06b None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:22:16.308775 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7470e-6f56-48ea-8c54-e67c8374f06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:16.310146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7470e-6f56-48ea-8c54-e67c8374f06b None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:16.317897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 592/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:22:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:16.323462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225cbbd-d291-465a-aaf3-7cb7cb9ec991 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:16.418439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225cbbd-d291-465a-aaf3-7cb7cb9ec991 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:16.449225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaee44-49b8-4f98-9b03-b8606d8091ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:16.450065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaee44-49b8-4f98-9b03-b8606d8091ce None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:16.450349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaee44-49b8-4f98-9b03-b8606d8091ce None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:16.450621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaee44-49b8-4f98-9b03-b8606d8091ce None admin] PATH_INFO: `/v3/users/40c941be9f5c4b0d862f0404b30d6b7a` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:16.451785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaee44-49b8-4f98-9b03-b8606d8091ce None admin] RBAC: Authorizing `identity:get_user(user_id=40c941be9f5c4b0d862f0404b30d6b7a)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:16.453188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaee44-49b8-4f98-9b03-b8606d8091ce None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:16.454759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 598/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:22:16 2022] GET /identity/v3/users/40c941be9f5c4b0d862f0404b30d6b7a => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:16.460375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7470e-6f56-48ea-8c54-e67c8374f06b None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:16.540587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:16.557767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7470e-6f56-48ea-8c54-e67c8374f06b None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:16.590048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bba881-6105-46aa-a195-c496012a69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:16.590876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bba881-6105-46aa-a195-c496012a69cf None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:16.591155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bba881-6105-46aa-a195-c496012a69cf None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:16.591429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bba881-6105-46aa-a195-c496012a69cf None admin] PATH_INFO: `/v3/projects/0af724979c4446e7a44736c2401a519b` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:16.592618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bba881-6105-46aa-a195-c496012a69cf None admin] RBAC: Authorizing `identity:get_project(project_id=0af724979c4446e7a44736c2401a519b)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:16.594050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bba881-6105-46aa-a195-c496012a69cf None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:16.595690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 593/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:22:16 2022] GET /identity/v3/projects/0af724979c4446e7a44736c2401a519b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:16.602066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaee44-49b8-4f98-9b03-b8606d8091ce None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:16.614394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:16.698250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaee44-49b8-4f98-9b03-b8606d8091ce None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:16.730561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1d6d8-e61b-4a37-b824-4546e2d26dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:16.731427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d6d8-e61b-4a37-b824-4546e2d26dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:16.731707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d6d8-e61b-4a37-b824-4546e2d26dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:16.732007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d6d8-e61b-4a37-b824-4546e2d26dc2 None admin] PATH_INFO: `/v3/projects/0af724979c4446e7a44736c2401a519b/users/40c941be9f5c4b0d862f0404b30d6b7a/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:16.733915 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1d6d8-e61b-4a37-b824-4546e2d26dc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0af724979c4446e7a44736c2401a519b, user_id=40c941be9f5c4b0d862f0404b30d6b7a, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:16.735331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1d6d8-e61b-4a37-b824-4546e2d26dc2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:16.790790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 599/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:22:16 2022] PUT /identity/v3/projects/0af724979c4446e7a44736c2401a519b/users/40c941be9f5c4b0d862f0404b30d6b7a/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:22:18.883838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d00ed-767a-4313-b1a8-1811e9811e10 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:18.884367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d00ed-767a-4313-b1a8-1811e9811e10 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:18.884367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d00ed-767a-4313-b1a8-1811e9811e10 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:18.885725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 594/1193] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:18.890773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8ded3-36e7-461d-b3bb-966fce061807 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:18.891207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8ded3-36e7-461d-b3bb-966fce061807 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:18.891332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8ded3-36e7-461d-b3bb-966fce061807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:18.908305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f3f8ded3-36e7-461d-b3bb-966fce061807 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:18.909479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f3f8ded3-36e7-461d-b3bb-966fce061807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:18.968780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:18.973045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 600/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:22:18.997042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d00ed-767a-4313-b1a8-1811e9811e10 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:19.097972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d00ed-767a-4313-b1a8-1811e9811e10 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:19.130379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7862d75-7213-4e60-86a4-731a3e269e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:19.131154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862d75-7213-4e60-86a4-731a3e269e7f None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:19.131437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862d75-7213-4e60-86a4-731a3e269e7f None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:19.132008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862d75-7213-4e60-86a4-731a3e269e7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:19.142160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7862d75-7213-4e60-86a4-731a3e269e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b7862d75-7213-4e60-86a4-731a3e269e7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:22:19.149663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:22:19.150736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:22:19.151619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 595/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:22:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:22:19.157031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8ded3-36e7-461d-b3bb-966fce061807 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:19.252282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8ded3-36e7-461d-b3bb-966fce061807 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:19.284504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a21e7f-4fa2-4efe-8586-18bcc94dd04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:19.285167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a21e7f-4fa2-4efe-8586-18bcc94dd04f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:19.285452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a21e7f-4fa2-4efe-8586-18bcc94dd04f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:19.285745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a21e7f-4fa2-4efe-8586-18bcc94dd04f None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:19.286462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a21e7f-4fa2-4efe-8586-18bcc94dd04f None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:22:19.286767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a21e7f-4fa2-4efe-8586-18bcc94dd04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:19.288150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a21e7f-4fa2-4efe-8586-18bcc94dd04f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:19.296499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 601/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:22:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:19.302086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7862d75-7213-4e60-86a4-731a3e269e7f None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:19.314530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:19.397221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7862d75-7213-4e60-86a4-731a3e269e7f None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:19.429564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958c0e-c400-41cc-b56b-8f24a649f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:19.430409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958c0e-c400-41cc-b56b-8f24a649f063 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:19.430688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958c0e-c400-41cc-b56b-8f24a649f063 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:19.430961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958c0e-c400-41cc-b56b-8f24a649f063 None admin] PATH_INFO: `/v3/users/40c941be9f5c4b0d862f0404b30d6b7a` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:19.432141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb958c0e-c400-41cc-b56b-8f24a649f063 None admin] RBAC: Authorizing `identity:get_user(user_id=40c941be9f5c4b0d862f0404b30d6b7a)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:19.433558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb958c0e-c400-41cc-b56b-8f24a649f063 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:19.435207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 596/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 16 00:22:19 2022] GET /identity/v3/users/40c941be9f5c4b0d862f0404b30d6b7a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:19.441002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a21e7f-4fa2-4efe-8586-18bcc94dd04f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:19.498965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:19.535497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a21e7f-4fa2-4efe-8586-18bcc94dd04f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:19.567102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b4136-644d-4731-8c45-0ff1e4b27c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:19.567752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b4136-644d-4731-8c45-0ff1e4b27c8a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:19.568037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b4136-644d-4731-8c45-0ff1e4b27c8a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:19.568309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b4136-644d-4731-8c45-0ff1e4b27c8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:19.631186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b4136-644d-4731-8c45-0ff1e4b27c8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:19.632915 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b4136-644d-4731-8c45-0ff1e4b27c8a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:19.688303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:19.725278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 602/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:22:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:22:19.731580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958c0e-c400-41cc-b56b-8f24a649f063 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:19.806844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:19.827394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958c0e-c400-41cc-b56b-8f24a649f063 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:19.860276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d696-3222-4e41-a549-0ba705d6e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:19.861112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d696-3222-4e41-a549-0ba705d6e40c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:19.861394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d696-3222-4e41-a549-0ba705d6e40c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:19.861671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d696-3222-4e41-a549-0ba705d6e40c None admin] PATH_INFO: `/v3/projects/0af724979c4446e7a44736c2401a519b` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:19.862830 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614d696-3222-4e41-a549-0ba705d6e40c None admin] RBAC: Authorizing `identity:get_project(project_id=0af724979c4446e7a44736c2401a519b)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:19.864298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614d696-3222-4e41-a549-0ba705d6e40c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:19.865951 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 597/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 16 00:22:19 2022] GET /identity/v3/projects/0af724979c4446e7a44736c2401a519b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:19.871946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b4136-644d-4731-8c45-0ff1e4b27c8a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:19.966869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b4136-644d-4731-8c45-0ff1e4b27c8a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:19.998448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c759420-6459-46d0-b9ec-83c195dc1d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:19.999077 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c759420-6459-46d0-b9ec-83c195dc1d85 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:19.999358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c759420-6459-46d0-b9ec-83c195dc1d85 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:19.999633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c759420-6459-46d0-b9ec-83c195dc1d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:20.000477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c759420-6459-46d0-b9ec-83c195dc1d85 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=0af724979c4446e7a44736c2401a519b, user.id=40c941be9f5c4b0d862f0404b30d6b7a) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:22:20.000784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c759420-6459-46d0-b9ec-83c195dc1d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:20.002194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c759420-6459-46d0-b9ec-83c195dc1d85 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:20.008567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 603/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:22:19 2022] GET /identity/v3/role_assignments?user.id=40c941be9f5c4b0d862f0404b30d6b7a&scope.project.id=0af724979c4446e7a44736c2401a519b&role.id=635caa85d8524fb887206fd521defd3f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:29.856204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=27 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:30.005271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=87 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:32.600985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899e2d4-8213-4510-a54d-4468cfb2f8e4 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:32.601605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899e2d4-8213-4510-a54d-4468cfb2f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:32.601605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899e2d4-8213-4510-a54d-4468cfb2f8e4 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:32.602884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 598/1201] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:32.607922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f475c6-f3c0-4cd5-a275-5707410027b1 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:32.608474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f475c6-f3c0-4cd5-a275-5707410027b1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:32.608584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f475c6-f3c0-4cd5-a275-5707410027b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:32.625555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-a9f475c6-f3c0-4cd5-a275-5707410027b1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:32.636571 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a9f475c6-f3c0-4cd5-a275-5707410027b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:32.692781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 604/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:23:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:23:32.716799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899e2d4-8213-4510-a54d-4468cfb2f8e4 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:32.815778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899e2d4-8213-4510-a54d-4468cfb2f8e4 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:32.848900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8833e5-5352-47fc-bbd5-2356b54a1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:32.849669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8833e5-5352-47fc-bbd5-2356b54a1094 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:32.849947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8833e5-5352-47fc-bbd5-2356b54a1094 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:32.850258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8833e5-5352-47fc-bbd5-2356b54a1094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:32.859939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8833e5-5352-47fc-bbd5-2356b54a1094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:32.861319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8833e5-5352-47fc-bbd5-2356b54a1094 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-af8833e5-5352-47fc-bbd5-2356b54a1094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:32.879801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:32.881905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:32.882857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:32.882857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:32.882857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:32.882857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:32.882857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 599/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:23:32.887916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f475c6-f3c0-4cd5-a275-5707410027b1 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:32.982075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f475c6-f3c0-4cd5-a275-5707410027b1 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:33.011284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:33.017063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128be3-cc19-4c17-a8f9-b84744c92613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:33.017720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128be3-cc19-4c17-a8f9-b84744c92613 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:33.018003 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128be3-cc19-4c17-a8f9-b84744c92613 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:33.018278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128be3-cc19-4c17-a8f9-b84744c92613 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:33.018992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128be3-cc19-4c17-a8f9-b84744c92613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:33.019297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128be3-cc19-4c17-a8f9-b84744c92613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:33.020703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128be3-cc19-4c17-a8f9-b84744c92613 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:33.032506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 605/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:33.038970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8833e5-5352-47fc-bbd5-2356b54a1094 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:33.096329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:33.143606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8833e5-5352-47fc-bbd5-2356b54a1094 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:33.178673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c5ef-0c6a-4175-8311-54f642d40c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:33.179324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c5ef-0c6a-4175-8311-54f642d40c44 None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:33.179604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c5ef-0c6a-4175-8311-54f642d40c44 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:33.179913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c5ef-0c6a-4175-8311-54f642d40c44 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:33.180597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736c5ef-0c6a-4175-8311-54f642d40c44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:33.182075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736c5ef-0c6a-4175-8311-54f642d40c44 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:33.307512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 600/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 16 00:23:33 2022] POST /identity/v3/users => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:23:35.422645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24996ee-ec6f-4e60-8787-6d16cfbf4435 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:35.423221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24996ee-ec6f-4e60-8787-6d16cfbf4435 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:35.423221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24996ee-ec6f-4e60-8787-6d16cfbf4435 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:35.424609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 606/1206] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:35.429785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d6583-7de2-473d-8c61-ef77442a6a9e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:35.430163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d6583-7de2-473d-8c61-ef77442a6a9e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:35.430341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d6583-7de2-473d-8c61-ef77442a6a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:35.446724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-533d6583-7de2-473d-8c61-ef77442a6a9e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:35.447921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-533d6583-7de2-473d-8c61-ef77442a6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:35.514968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 601/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:23:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:23:35.538875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24996ee-ec6f-4e60-8787-6d16cfbf4435 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:35.639951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24996ee-ec6f-4e60-8787-6d16cfbf4435 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:35.673570 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb73bbe-bc36-4175-afba-9ba5bafd4b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:35.674297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73bbe-bc36-4175-afba-9ba5bafd4b74 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:35.674574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73bbe-bc36-4175-afba-9ba5bafd4b74 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:35.674845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73bbe-bc36-4175-afba-9ba5bafd4b74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:35.685946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb73bbe-bc36-4175-afba-9ba5bafd4b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-1cb73bbe-bc36-4175-afba-9ba5bafd4b74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:23:35.694073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:35.697585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:35.698635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 607/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:23:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:35.701286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d6583-7de2-473d-8c61-ef77442a6a9e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:35.740718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:35.796871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d6583-7de2-473d-8c61-ef77442a6a9e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:35.829895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e9fc0-ce01-4315-9f2c-f167ebba3ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:35.830799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e9fc0-ce01-4315-9f2c-f167ebba3ba2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:35.830799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e9fc0-ce01-4315-9f2c-f167ebba3ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:35.831096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e9fc0-ce01-4315-9f2c-f167ebba3ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:35.831861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e9fc0-ce01-4315-9f2c-f167ebba3ba2 None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:35.832171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e9fc0-ce01-4315-9f2c-f167ebba3ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:35.834151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e9fc0-ce01-4315-9f2c-f167ebba3ba2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:35.841750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 602/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:23:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:35.847412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb73bbe-bc36-4175-afba-9ba5bafd4b74 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:35.896438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:35.945189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb73bbe-bc36-4175-afba-9ba5bafd4b74 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:35.977295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a907c0-a9ea-4e21-ac89-d3754b1e5e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:35.978093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a907c0-a9ea-4e21-ac89-d3754b1e5e76 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:35.978377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a907c0-a9ea-4e21-ac89-d3754b1e5e76 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:35.978654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a907c0-a9ea-4e21-ac89-d3754b1e5e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:35.988556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a907c0-a9ea-4e21-ac89-d3754b1e5e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:35.990542 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a907c0-a9ea-4e21-ac89-d3754b1e5e76 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-d0a907c0-a9ea-4e21-ac89-d3754b1e5e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:36.008885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:36.009939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:36.010897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:36.010897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:36.010897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:36.010897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:36.010897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 608/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:36.015913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e9fc0-ce01-4315-9f2c-f167ebba3ba2 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:36.109818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:36.112665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e9fc0-ce01-4315-9f2c-f167ebba3ba2 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:36.146060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b593adf-ca1d-4ae9-83ca-4294f1f8a405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:36.146710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b593adf-ca1d-4ae9-83ca-4294f1f8a405 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:36.146994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b593adf-ca1d-4ae9-83ca-4294f1f8a405 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:36.147274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b593adf-ca1d-4ae9-83ca-4294f1f8a405 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:36.148539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b593adf-ca1d-4ae9-83ca-4294f1f8a405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:36.148850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b593adf-ca1d-4ae9-83ca-4294f1f8a405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:36.150233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b593adf-ca1d-4ae9-83ca-4294f1f8a405 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:36.161822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 603/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:36.167431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a907c0-a9ea-4e21-ac89-d3754b1e5e76 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:36.267696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a907c0-a9ea-4e21-ac89-d3754b1e5e76 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:36.269166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:36.301453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462b9be-bff6-4667-9d9c-e559c76a98f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:36.303040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462b9be-bff6-4667-9d9c-e559c76a98f8 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:36.303330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462b9be-bff6-4667-9d9c-e559c76a98f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:36.303610 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462b9be-bff6-4667-9d9c-e559c76a98f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:36.310619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462b9be-bff6-4667-9d9c-e559c76a98f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:36.312084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462b9be-bff6-4667-9d9c-e559c76a98f8 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-f462b9be-bff6-4667-9d9c-e559c76a98f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:23:36.327144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:36.332400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:36.333942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 609/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:36.334740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b593adf-ca1d-4ae9-83ca-4294f1f8a405 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:36.432544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b593adf-ca1d-4ae9-83ca-4294f1f8a405 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:36.466042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e22a60-3ba2-48e1-83f1-9d9d8e7fc3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:36.466699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e22a60-3ba2-48e1-83f1-9d9d8e7fc3bc None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:36.466984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e22a60-3ba2-48e1-83f1-9d9d8e7fc3bc None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:36.467259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e22a60-3ba2-48e1-83f1-9d9d8e7fc3bc None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:36.468112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e22a60-3ba2-48e1-83f1-9d9d8e7fc3bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:36.468421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e22a60-3ba2-48e1-83f1-9d9d8e7fc3bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:36.469850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e22a60-3ba2-48e1-83f1-9d9d8e7fc3bc None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:36.486270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 604/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 16 00:23:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:36.494542 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462b9be-bff6-4667-9d9c-e559c76a98f8 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:36.605982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462b9be-bff6-4667-9d9c-e559c76a98f8 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:36.642476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3863fe-edb8-444e-972f-8eca70f6a595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:36.643118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3863fe-edb8-444e-972f-8eca70f6a595 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:36.643405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3863fe-edb8-444e-972f-8eca70f6a595 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:36.643683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3863fe-edb8-444e-972f-8eca70f6a595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:36.674233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:36.710150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3863fe-edb8-444e-972f-8eca70f6a595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:36.711678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3863fe-edb8-444e-972f-8eca70f6a595 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:36.811118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 610/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:23:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:23:36.817178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e22a60-3ba2-48e1-83f1-9d9d8e7fc3bc None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:36.836067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:36.913428 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e22a60-3ba2-48e1-83f1-9d9d8e7fc3bc None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:36.956021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb565b-7674-4c42-b097-76a9a4e0f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:36.956813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb565b-7674-4c42-b097-76a9a4e0f3fb None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:36.957125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb565b-7674-4c42-b097-76a9a4e0f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:36.957399 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb565b-7674-4c42-b097-76a9a4e0f3fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:36.967430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb565b-7674-4c42-b097-76a9a4e0f3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:36.968932 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb565b-7674-4c42-b097-76a9a4e0f3fb None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-eadb565b-7674-4c42-b097-76a9a4e0f3fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:36.986147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:36.992650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:36.993744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:36.993744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:36.993744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:36.993744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:36.993744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 605/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:23:36.994099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3863fe-edb8-444e-972f-8eca70f6a595 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:37.055152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:37.091605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3863fe-edb8-444e-972f-8eca70f6a595 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:37.126301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4e55-3820-4d7e-a35b-5061b79544c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:37.127012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4e55-3820-4d7e-a35b-5061b79544c7 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:37.127300 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4e55-3820-4d7e-a35b-5061b79544c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:37.127576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4e55-3820-4d7e-a35b-5061b79544c7 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:37.128319 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d4e55-3820-4d7e-a35b-5061b79544c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:37.128628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d4e55-3820-4d7e-a35b-5061b79544c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:37.129983 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d4e55-3820-4d7e-a35b-5061b79544c7 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:37.141530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 611/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:37.147314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb565b-7674-4c42-b097-76a9a4e0f3fb None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:37.214441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:37.244180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb565b-7674-4c42-b097-76a9a4e0f3fb None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:37.277445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feece8-e141-4ccf-bc17-e74bc6f03e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:37.278225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feece8-e141-4ccf-bc17-e74bc6f03e72 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:37.278509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feece8-e141-4ccf-bc17-e74bc6f03e72 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:37.278787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feece8-e141-4ccf-bc17-e74bc6f03e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:37.285203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45feece8-e141-4ccf-bc17-e74bc6f03e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:37.287169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45feece8-e141-4ccf-bc17-e74bc6f03e72 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-45feece8-e141-4ccf-bc17-e74bc6f03e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:23:37.300557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:37.301538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:37.303152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:23:37.303152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:23:37.303152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:23:37.303152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:23:37.303152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:23:37.303152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:23:37.303152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:37.303152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:37.303152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 606/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:37.308366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4e55-3820-4d7e-a35b-5061b79544c7 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:37.405931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4e55-3820-4d7e-a35b-5061b79544c7 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:37.428316 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:37.439749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28845e37-f18f-46e3-a52d-37d9edee20b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:37.440411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845e37-f18f-46e3-a52d-37d9edee20b6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:37.440695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845e37-f18f-46e3-a52d-37d9edee20b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:37.440971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845e37-f18f-46e3-a52d-37d9edee20b6 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:37.441743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28845e37-f18f-46e3-a52d-37d9edee20b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:37.442051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28845e37-f18f-46e3-a52d-37d9edee20b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:37.443516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28845e37-f18f-46e3-a52d-37d9edee20b6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:37.455163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 612/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:37.461809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feece8-e141-4ccf-bc17-e74bc6f03e72 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:37.560428 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feece8-e141-4ccf-bc17-e74bc6f03e72 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:37.587320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:37.592987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d19e23-21bf-4d5a-be6f-3075a7be098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:37.593671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d19e23-21bf-4d5a-be6f-3075a7be098e None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:37.593951 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d19e23-21bf-4d5a-be6f-3075a7be098e None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:37.594218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d19e23-21bf-4d5a-be6f-3075a7be098e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:37.595029 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d19e23-21bf-4d5a-be6f-3075a7be098e None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=b2e57a7647d143f5835225616138827e) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:37.595333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d19e23-21bf-4d5a-be6f-3075a7be098e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:37.596787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d19e23-21bf-4d5a-be6f-3075a7be098e None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:37.602576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 607/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:23:37 2022] GET /identity/v3/role_assignments?user.id=b2e57a7647d143f5835225616138827e&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:39.671187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1b296-4460-42be-bed9-4463ed23e368 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:39.671773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1b296-4460-42be-bed9-4463ed23e368 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:39.671773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1b296-4460-42be-bed9-4463ed23e368 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:39.673134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 613/1220] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:39.678404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f5c6-a9c0-4f0d-9b4d-a5f3c5b041be None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:39.678809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f5c6-a9c0-4f0d-9b4d-a5f3c5b041be None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:39.678956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f5c6-a9c0-4f0d-9b4d-a5f3c5b041be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:39.695385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-6068f5c6-a9c0-4f0d-9b4d-a5f3c5b041be None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:39.696655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-6068f5c6-a9c0-4f0d-9b4d-a5f3c5b041be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:39.762998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 608/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:23:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:23:39.785352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1b296-4460-42be-bed9-4463ed23e368 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:39.885971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1b296-4460-42be-bed9-4463ed23e368 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:39.919841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323632c-af52-4283-874a-8d3260cc3548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:39.920629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323632c-af52-4283-874a-8d3260cc3548 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:39.920912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323632c-af52-4283-874a-8d3260cc3548 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:39.921234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323632c-af52-4283-874a-8d3260cc3548 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:39.931506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323632c-af52-4283-874a-8d3260cc3548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e323632c-af52-4283-874a-8d3260cc3548 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:23:39.939137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:39.940317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:39.941368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 614/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:23:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:39.946794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068f5c6-a9c0-4f0d-9b4d-a5f3c5b041be None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:40.045311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068f5c6-a9c0-4f0d-9b4d-a5f3c5b041be None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:40.069187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:40.079507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca380-ddaf-413c-8408-cac8e0932313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:40.080207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca380-ddaf-413c-8408-cac8e0932313 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:40.080489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca380-ddaf-413c-8408-cac8e0932313 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:40.080761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca380-ddaf-413c-8408-cac8e0932313 None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:40.081489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cca380-ddaf-413c-8408-cac8e0932313 None admin] RBAC: Adding query filter params (name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:40.081791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cca380-ddaf-413c-8408-cac8e0932313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:40.083162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cca380-ddaf-413c-8408-cac8e0932313 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:40.091547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 609/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:23:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:40.097274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323632c-af52-4283-874a-8d3260cc3548 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:40.140837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:40.196682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323632c-af52-4283-874a-8d3260cc3548 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:40.229819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4019be7-e112-4e06-b673-74650fc8b66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:40.230594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4019be7-e112-4e06-b673-74650fc8b66a None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:40.230877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4019be7-e112-4e06-b673-74650fc8b66a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:40.231153 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4019be7-e112-4e06-b673-74650fc8b66a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:40.241502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4019be7-e112-4e06-b673-74650fc8b66a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:40.242931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4019be7-e112-4e06-b673-74650fc8b66a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-a4019be7-e112-4e06-b673-74650fc8b66a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:40.260434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:40.261467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:40.262509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:40.262509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:40.262509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:40.262509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:40.262509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 615/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:40.267558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca380-ddaf-413c-8408-cac8e0932313 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:40.367138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca380-ddaf-413c-8408-cac8e0932313 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:40.400548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50dd24-abd6-48ca-9a28-271c9546b586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:40.401200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50dd24-abd6-48ca-9a28-271c9546b586 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:40.401491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50dd24-abd6-48ca-9a28-271c9546b586 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:40.401772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50dd24-abd6-48ca-9a28-271c9546b586 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:40.402485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50dd24-abd6-48ca-9a28-271c9546b586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:40.402796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50dd24-abd6-48ca-9a28-271c9546b586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:40.404263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50dd24-abd6-48ca-9a28-271c9546b586 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:40.416402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 610/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:40.422081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4019be7-e112-4e06-b673-74650fc8b66a None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:40.512966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:40.519462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4019be7-e112-4e06-b673-74650fc8b66a None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:40.551136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb8e49-24f3-40c7-ae3f-5e1956b53a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:40.552537 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8e49-24f3-40c7-ae3f-5e1956b53a88 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:40.552821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8e49-24f3-40c7-ae3f-5e1956b53a88 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:40.553091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8e49-24f3-40c7-ae3f-5e1956b53a88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:40.560258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb8e49-24f3-40c7-ae3f-5e1956b53a88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:40.561714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb8e49-24f3-40c7-ae3f-5e1956b53a88 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-adeb8e49-24f3-40c7-ae3f-5e1956b53a88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:23:40.576186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:40.577321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:40.578493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 616/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:40.583224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50dd24-abd6-48ca-9a28-271c9546b586 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:40.628692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:40.680304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50dd24-abd6-48ca-9a28-271c9546b586 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:40.713927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b283-e496-4967-884f-f38e03aa1b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:40.714586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b283-e496-4967-884f-f38e03aa1b70 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:40.714869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b283-e496-4967-884f-f38e03aa1b70 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:40.715144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b283-e496-4967-884f-f38e03aa1b70 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:40.715992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28b283-e496-4967-884f-f38e03aa1b70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:40.716300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28b283-e496-4967-884f-f38e03aa1b70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:40.717735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28b283-e496-4967-884f-f38e03aa1b70 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:40.734616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 611/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 16 00:23:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:40.740757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb8e49-24f3-40c7-ae3f-5e1956b53a88 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:40.838292 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb8e49-24f3-40c7-ae3f-5e1956b53a88 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:40.871568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070fa15-2e70-4568-8934-ffe273cf0edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:40.872374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070fa15-2e70-4568-8934-ffe273cf0edb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:40.872682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070fa15-2e70-4568-8934-ffe273cf0edb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:40.872953 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070fa15-2e70-4568-8934-ffe273cf0edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:40.883492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070fa15-2e70-4568-8934-ffe273cf0edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:40.884999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070fa15-2e70-4568-8934-ffe273cf0edb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-0070fa15-2e70-4568-8934-ffe273cf0edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:40.901416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:40.902526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:40.903649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:40.903649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:40.903649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:40.903649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:40.903649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 617/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:40.908401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b283-e496-4967-884f-f38e03aa1b70 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:41.005858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b283-e496-4967-884f-f38e03aa1b70 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:41.008453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:41.039743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5debd-8c77-449b-a97e-2d5b6ab29627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:41.040404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5debd-8c77-449b-a97e-2d5b6ab29627 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:41.041052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5debd-8c77-449b-a97e-2d5b6ab29627 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:41.041052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5debd-8c77-449b-a97e-2d5b6ab29627 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:41.041646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5debd-8c77-449b-a97e-2d5b6ab29627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:41.041952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5debd-8c77-449b-a97e-2d5b6ab29627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:41.043324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5debd-8c77-449b-a97e-2d5b6ab29627 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:41.054916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 612/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:41.060563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070fa15-2e70-4568-8934-ffe273cf0edb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:41.069863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:41.158541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070fa15-2e70-4568-8934-ffe273cf0edb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:41.191476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956168d-a1bc-45b2-b90b-4b251f91ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:41.192303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956168d-a1bc-45b2-b90b-4b251f91ba66 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:41.192619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956168d-a1bc-45b2-b90b-4b251f91ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:41.192899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956168d-a1bc-45b2-b90b-4b251f91ba66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:41.199505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956168d-a1bc-45b2-b90b-4b251f91ba66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:41.200974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956168d-a1bc-45b2-b90b-4b251f91ba66 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-e956168d-a1bc-45b2-b90b-4b251f91ba66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:23:41.215422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:41.216635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:41.217729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:23:41.217729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:23:41.217729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:23:41.217729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:23:41.217729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:23:41.217729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:23:41.217729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:41.217729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:41.217729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 618/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:41.222539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5debd-8c77-449b-a97e-2d5b6ab29627 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:41.320452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5debd-8c77-449b-a97e-2d5b6ab29627 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:41.353737 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cd5f7-9afa-441e-ba12-032f1545bdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:41.354396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd5f7-9afa-441e-ba12-032f1545bdf8 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:41.354677 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd5f7-9afa-441e-ba12-032f1545bdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:41.354956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd5f7-9afa-441e-ba12-032f1545bdf8 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:41.355747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cd5f7-9afa-441e-ba12-032f1545bdf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:41.356073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cd5f7-9afa-441e-ba12-032f1545bdf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:41.357514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cd5f7-9afa-441e-ba12-032f1545bdf8 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:41.369512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 613/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:41.375477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956168d-a1bc-45b2-b90b-4b251f91ba66 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:41.441532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:41.476054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956168d-a1bc-45b2-b90b-4b251f91ba66 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:41.509948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ba6c-9157-46ec-8878-fdadeca4207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:41.510820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ba6c-9157-46ec-8878-fdadeca4207a None admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:41.511102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ba6c-9157-46ec-8878-fdadeca4207a None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:41.511379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ba6c-9157-46ec-8878-fdadeca4207a None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/b2e57a7647d143f5835225616138827e/roles/ef759eb79f6242fbbc2ec11a7807ad23` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:41.525314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3ba6c-9157-46ec-8878-fdadeca4207a None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=b2e57a7647d143f5835225616138827e, role_id=ef759eb79f6242fbbc2ec11a7807ad23)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:41.526762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3ba6c-9157-46ec-8878-fdadeca4207a None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:41.660713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 619/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:23:41 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/b2e57a7647d143f5835225616138827e/roles/ef759eb79f6242fbbc2ec11a7807ad23 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:23:43.744187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4650c-83eb-446f-99af-c8a2b5ec7e7e None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:43.744714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4650c-83eb-446f-99af-c8a2b5ec7e7e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:43.744830 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4650c-83eb-446f-99af-c8a2b5ec7e7e None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:43.746129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 614/1233] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:43.751266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4bb9a-1b7e-4e3f-8cac-0d5e5ddcb983 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:43.751761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4bb9a-1b7e-4e3f-8cac-0d5e5ddcb983 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:43.751865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4bb9a-1b7e-4e3f-8cac-0d5e5ddcb983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:43.768696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-bce4bb9a-1b7e-4e3f-8cac-0d5e5ddcb983 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:43.769871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-bce4bb9a-1b7e-4e3f-8cac-0d5e5ddcb983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:43.833873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 620/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:23:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:23:43.857085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4650c-83eb-446f-99af-c8a2b5ec7e7e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:43.882441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:43.955864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4650c-83eb-446f-99af-c8a2b5ec7e7e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:43.988285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b3a91-3066-4b4c-8c80-ea6ef67612e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:43.989061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b3a91-3066-4b4c-8c80-ea6ef67612e3 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:43.989341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b3a91-3066-4b4c-8c80-ea6ef67612e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:43.989616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b3a91-3066-4b4c-8c80-ea6ef67612e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:43.999299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b3a91-3066-4b4c-8c80-ea6ef67612e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-c39b3a91-3066-4b4c-8c80-ea6ef67612e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:23:44.007803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:44.011654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:44.012749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 615/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 16 00:23:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:44.015000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4bb9a-1b7e-4e3f-8cac-0d5e5ddcb983 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:44.062745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:44.115263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4bb9a-1b7e-4e3f-8cac-0d5e5ddcb983 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:44.147661 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c60d6-e1b0-4055-9d6b-b76f3b9c5bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:44.148399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c60d6-e1b0-4055-9d6b-b76f3b9c5bb1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:44.148678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c60d6-e1b0-4055-9d6b-b76f3b9c5bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:44.148950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c60d6-e1b0-4055-9d6b-b76f3b9c5bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:44.149673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c60d6-e1b0-4055-9d6b-b76f3b9c5bb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:44.149973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c60d6-e1b0-4055-9d6b-b76f3b9c5bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:44.151317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c60d6-e1b0-4055-9d6b-b76f3b9c5bb1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:44.159482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 621/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 16 00:23:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:44.166053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b3a91-3066-4b4c-8c80-ea6ef67612e3 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:44.250110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:44.265400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b3a91-3066-4b4c-8c80-ea6ef67612e3 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:44.297616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f20e0-8d01-453f-adf7-8a5cd0a00055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:44.298397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f20e0-8d01-453f-adf7-8a5cd0a00055 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:44.298677 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f20e0-8d01-453f-adf7-8a5cd0a00055 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:44.298947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f20e0-8d01-453f-adf7-8a5cd0a00055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:44.309254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f20e0-8d01-453f-adf7-8a5cd0a00055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:44.310692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f20e0-8d01-453f-adf7-8a5cd0a00055 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-2f0f20e0-8d01-453f-adf7-8a5cd0a00055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:44.327131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:44.328127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:44.329028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:44.329028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:44.329028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:44.329028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:44.329028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 616/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:44.334524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c60d6-e1b0-4055-9d6b-b76f3b9c5bb1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:44.433899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c60d6-e1b0-4055-9d6b-b76f3b9c5bb1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:44.443577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:44.467015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb207e8-f771-49f2-98a3-259a9c88966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:44.467675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb207e8-f771-49f2-98a3-259a9c88966e None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:44.467987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb207e8-f771-49f2-98a3-259a9c88966e None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:44.468264 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb207e8-f771-49f2-98a3-259a9c88966e None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:44.468969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb207e8-f771-49f2-98a3-259a9c88966e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:44.469277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb207e8-f771-49f2-98a3-259a9c88966e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:44.470670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb207e8-f771-49f2-98a3-259a9c88966e None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:44.481509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 622/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:23:44.487098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f20e0-8d01-453f-adf7-8a5cd0a00055 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:44.585105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f20e0-8d01-453f-adf7-8a5cd0a00055 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:44.617559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081586be-94c8-43b7-8a63-ac5d24bac856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:44.618347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081586be-94c8-43b7-8a63-ac5d24bac856 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:44.618627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081586be-94c8-43b7-8a63-ac5d24bac856 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:44.618901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081586be-94c8-43b7-8a63-ac5d24bac856 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:44.621537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:44.626570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081586be-94c8-43b7-8a63-ac5d24bac856 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:44.628037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081586be-94c8-43b7-8a63-ac5d24bac856 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-081586be-94c8-43b7-8a63-ac5d24bac856 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:23:44.642086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:44.643286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:44.644663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 617/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:44.649005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb207e8-f771-49f2-98a3-259a9c88966e None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:44.744687 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb207e8-f771-49f2-98a3-259a9c88966e None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:44.778043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb3fff-bf6e-4a22-84e4-75f0694ee5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:44.778704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb3fff-bf6e-4a22-84e4-75f0694ee5bb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:44.778987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb3fff-bf6e-4a22-84e4-75f0694ee5bb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:44.779265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb3fff-bf6e-4a22-84e4-75f0694ee5bb None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:44.780134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb3fff-bf6e-4a22-84e4-75f0694ee5bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:44.780443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb3fff-bf6e-4a22-84e4-75f0694ee5bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:44.782066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb3fff-bf6e-4a22-84e4-75f0694ee5bb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:44.799428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 623/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 16 00:23:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:44.805047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081586be-94c8-43b7-8a63-ac5d24bac856 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:44.903334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081586be-94c8-43b7-8a63-ac5d24bac856 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:44.936057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28569539-3d35-4fd2-8aea-5a0b818c75bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:44.936738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28569539-3d35-4fd2-8aea-5a0b818c75bb None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:44.937023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28569539-3d35-4fd2-8aea-5a0b818c75bb None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:44.937300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28569539-3d35-4fd2-8aea-5a0b818c75bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:44.996624 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:45.002904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28569539-3d35-4fd2-8aea-5a0b818c75bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:45.004400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28569539-3d35-4fd2-8aea-5a0b818c75bb None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:45.100565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 618/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:23:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:23:45.106442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb3fff-bf6e-4a22-84e4-75f0694ee5bb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:45.134861 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:45.204957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb3fff-bf6e-4a22-84e4-75f0694ee5bb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:45.237692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13e2e9-286b-49bb-98a2-3d2cee699940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:45.238486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13e2e9-286b-49bb-98a2-3d2cee699940 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:45.238769 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13e2e9-286b-49bb-98a2-3d2cee699940 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:45.239040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13e2e9-286b-49bb-98a2-3d2cee699940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:45.249298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13e2e9-286b-49bb-98a2-3d2cee699940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:45.250919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13e2e9-286b-49bb-98a2-3d2cee699940 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-4d13e2e9-286b-49bb-98a2-3d2cee699940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:45.269688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:45.270811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:45.271918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:45.271918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:45.271918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:45.271918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:45.271918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 624/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:45.276782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28569539-3d35-4fd2-8aea-5a0b818c75bb None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:45.366979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:45.372752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28569539-3d35-4fd2-8aea-5a0b818c75bb None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:45.405290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcbe1e-96c0-4425-8580-749468536b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:45.405955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbe1e-96c0-4425-8580-749468536b61 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:45.406262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbe1e-96c0-4425-8580-749468536b61 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:45.406542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbe1e-96c0-4425-8580-749468536b61 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:45.407279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcbe1e-96c0-4425-8580-749468536b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:45.407585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcbe1e-96c0-4425-8580-749468536b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:45.408980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcbe1e-96c0-4425-8580-749468536b61 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:45.420784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 619/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:23:45.426393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13e2e9-286b-49bb-98a2-3d2cee699940 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:45.502575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:45.523282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13e2e9-286b-49bb-98a2-3d2cee699940 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:45.556382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e17fc-1eb2-45fd-9e45-20548d2e80a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:45.557164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e17fc-1eb2-45fd-9e45-20548d2e80a5 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:45.557442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e17fc-1eb2-45fd-9e45-20548d2e80a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:45.557715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e17fc-1eb2-45fd-9e45-20548d2e80a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:45.564141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e17fc-1eb2-45fd-9e45-20548d2e80a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:45.565559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e17fc-1eb2-45fd-9e45-20548d2e80a5 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-624e17fc-1eb2-45fd-9e45-20548d2e80a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:23:45.578707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:45.579764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:45.580950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:23:45.580950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:23:45.580950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:23:45.580950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:23:45.580950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:23:45.580950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:23:45.580950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:45.580950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:45.580950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 625/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:45.585715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcbe1e-96c0-4425-8580-749468536b61 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:45.685668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcbe1e-96c0-4425-8580-749468536b61 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:45.718700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6787a59-19ce-4b00-9c98-442498bd3db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:45.719451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787a59-19ce-4b00-9c98-442498bd3db7 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:45.719750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787a59-19ce-4b00-9c98-442498bd3db7 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:45.720039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787a59-19ce-4b00-9c98-442498bd3db7 None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:45.720809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6787a59-19ce-4b00-9c98-442498bd3db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:45.721117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6787a59-19ce-4b00-9c98-442498bd3db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:45.722597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6787a59-19ce-4b00-9c98-442498bd3db7 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:45.734894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 620/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:23:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:23:45.741418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e17fc-1eb2-45fd-9e45-20548d2e80a5 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:45.839613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e17fc-1eb2-45fd-9e45-20548d2e80a5 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:45.871637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65343c19-a070-4b7c-9980-4d051342fbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:45.872310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65343c19-a070-4b7c-9980-4d051342fbbd None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:45.872603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65343c19-a070-4b7c-9980-4d051342fbbd None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:45.872869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65343c19-a070-4b7c-9980-4d051342fbbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:45.873780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65343c19-a070-4b7c-9980-4d051342fbbd None admin] RBAC: Adding query filter params (role.id=ef759eb79f6242fbbc2ec11a7807ad23, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=b2e57a7647d143f5835225616138827e) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:45.874090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65343c19-a070-4b7c-9980-4d051342fbbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:45.875508 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65343c19-a070-4b7c-9980-4d051342fbbd None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:45.881427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 626/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:23:45 2022] GET /identity/v3/role_assignments?user.id=b2e57a7647d143f5835225616138827e&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=ef759eb79f6242fbbc2ec11a7807ad23 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:48.052528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9edc-d7f3-454b-9d63-6c850da7171d None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:48.052925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9edc-d7f3-454b-9d63-6c850da7171d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:48.053090 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9edc-d7f3-454b-9d63-6c850da7171d None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:48.054456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 621/1247] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:48.059663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517ae84-ba43-41c4-9a93-f3bc7df41303 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:48.060112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517ae84-ba43-41c4-9a93-f3bc7df41303 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:48.060250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517ae84-ba43-41c4-9a93-f3bc7df41303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:48.065318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:48.077055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7517ae84-ba43-41c4-9a93-f3bc7df41303 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:48.078223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7517ae84-ba43-41c4-9a93-f3bc7df41303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:48.144034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 627/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:23:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:23:48.168518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a9edc-d7f3-454b-9d63-6c850da7171d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:48.186089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:48.267833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a9edc-d7f3-454b-9d63-6c850da7171d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:48.300389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f15529-b1eb-4f28-a4bc-f37389bbc134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:48.301133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15529-b1eb-4f28-a4bc-f37389bbc134 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:48.301411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15529-b1eb-4f28-a4bc-f37389bbc134 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:48.302241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15529-b1eb-4f28-a4bc-f37389bbc134 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:48.312090 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f15529-b1eb-4f28-a4bc-f37389bbc134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-55f15529-b1eb-4f28-a4bc-f37389bbc134 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:23:48.319828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:48.321103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:48.322031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 622/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:48.327051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517ae84-ba43-41c4-9a93-f3bc7df41303 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:48.423236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517ae84-ba43-41c4-9a93-f3bc7df41303 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:48.451469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:48.456173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897c0c9-002c-44be-9249-d38e08b790d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:48.456824 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897c0c9-002c-44be-9249-d38e08b790d0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:48.457110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897c0c9-002c-44be-9249-d38e08b790d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:48.457385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897c0c9-002c-44be-9249-d38e08b790d0 None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:48.458724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897c0c9-002c-44be-9249-d38e08b790d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:48.459030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897c0c9-002c-44be-9249-d38e08b790d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:48.460412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897c0c9-002c-44be-9249-d38e08b790d0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:48.468449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 628/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:48.474812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f15529-b1eb-4f28-a4bc-f37389bbc134 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:48.550459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:48.572032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f15529-b1eb-4f28-a4bc-f37389bbc134 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:48.603662 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a061fb-be5a-4a48-b3ea-1365b5df3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:48.604488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a061fb-be5a-4a48-b3ea-1365b5df3260 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:48.604775 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a061fb-be5a-4a48-b3ea-1365b5df3260 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:48.605046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a061fb-be5a-4a48-b3ea-1365b5df3260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:48.615969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a061fb-be5a-4a48-b3ea-1365b5df3260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:48.617409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a061fb-be5a-4a48-b3ea-1365b5df3260 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-d8a061fb-be5a-4a48-b3ea-1365b5df3260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:48.634396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:48.635856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:48.636749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:48.636749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:48.636749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:48.636749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:48.636749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 623/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:48.641588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897c0c9-002c-44be-9249-d38e08b790d0 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:48.742191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897c0c9-002c-44be-9249-d38e08b790d0 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:48.774703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbc7c4-08d9-419b-a482-edcc0af058b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:48.775336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbc7c4-08d9-419b-a482-edcc0af058b3 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:48.775615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbc7c4-08d9-419b-a482-edcc0af058b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:48.775914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbc7c4-08d9-419b-a482-edcc0af058b3 None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:48.776616 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbc7c4-08d9-419b-a482-edcc0af058b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:48.776919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbc7c4-08d9-419b-a482-edcc0af058b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:48.778262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbc7c4-08d9-419b-a482-edcc0af058b3 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:48.790419 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 629/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:48.796377 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a061fb-be5a-4a48-b3ea-1365b5df3260 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:48.893176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a061fb-be5a-4a48-b3ea-1365b5df3260 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:48.919088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:48.926621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746a403-5e13-4edd-b3cd-5583251f8156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:48.927429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746a403-5e13-4edd-b3cd-5583251f8156 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:48.927748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746a403-5e13-4edd-b3cd-5583251f8156 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:48.928036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746a403-5e13-4edd-b3cd-5583251f8156 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:48.935218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746a403-5e13-4edd-b3cd-5583251f8156 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:48.936801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746a403-5e13-4edd-b3cd-5583251f8156 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-d746a403-5e13-4edd-b3cd-5583251f8156 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:23:48.950604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:48.951541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:48.952609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 624/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:48.958285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbc7c4-08d9-419b-a482-edcc0af058b3 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:49.011983 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:49.054470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbc7c4-08d9-419b-a482-edcc0af058b3 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:49.087857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edc737-6dc9-49bd-936a-9650df4b745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:49.088523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edc737-6dc9-49bd-936a-9650df4b745d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:49.088807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edc737-6dc9-49bd-936a-9650df4b745d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:49.089081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edc737-6dc9-49bd-936a-9650df4b745d None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:49.089900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edc737-6dc9-49bd-936a-9650df4b745d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:49.090206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edc737-6dc9-49bd-936a-9650df4b745d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:49.091631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edc737-6dc9-49bd-936a-9650df4b745d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:49.107865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 630/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 16 00:23:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:49.113845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746a403-5e13-4edd-b3cd-5583251f8156 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:49.213037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746a403-5e13-4edd-b3cd-5583251f8156 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:49.244612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d1f7-1d16-4400-91db-7d21e386973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:49.245245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d1f7-1d16-4400-91db-7d21e386973d None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:49.245566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d1f7-1d16-4400-91db-7d21e386973d None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:49.245845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d1f7-1d16-4400-91db-7d21e386973d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:49.298679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:49.310247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3d1f7-1d16-4400-91db-7d21e386973d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:49.311726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3d1f7-1d16-4400-91db-7d21e386973d None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:49.408859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 625/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:23:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:23:49.414618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edc737-6dc9-49bd-936a-9650df4b745d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:49.511648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edc737-6dc9-49bd-936a-9650df4b745d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:49.524540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:49.545836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cb64c-d4ec-456f-bdc1-7ec49faa50e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:49.546620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cb64c-d4ec-456f-bdc1-7ec49faa50e8 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:49.546903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cb64c-d4ec-456f-bdc1-7ec49faa50e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:49.547170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cb64c-d4ec-456f-bdc1-7ec49faa50e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:49.557323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cb64c-d4ec-456f-bdc1-7ec49faa50e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:49.558749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cb64c-d4ec-456f-bdc1-7ec49faa50e8 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-304cb64c-d4ec-456f-bdc1-7ec49faa50e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:49.575907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:49.578896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:49.580047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:49.580047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:49.580047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:49.580047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:49.580047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 631/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:49.582826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d1f7-1d16-4400-91db-7d21e386973d None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:49.670037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:49.682132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d1f7-1d16-4400-91db-7d21e386973d None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:49.714991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc90872-5228-4658-a79e-0dfe9cdeb0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:49.715632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90872-5228-4658-a79e-0dfe9cdeb0a9 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:49.715937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90872-5228-4658-a79e-0dfe9cdeb0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:49.716211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90872-5228-4658-a79e-0dfe9cdeb0a9 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:49.716915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc90872-5228-4658-a79e-0dfe9cdeb0a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:49.717214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc90872-5228-4658-a79e-0dfe9cdeb0a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:49.718676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc90872-5228-4658-a79e-0dfe9cdeb0a9 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:49.730238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 626/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:49.736029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cb64c-d4ec-456f-bdc1-7ec49faa50e8 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:49.832766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cb64c-d4ec-456f-bdc1-7ec49faa50e8 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:49.866756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b84acc-dc3a-4693-b077-fb9e0eb9baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:49.867540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b84acc-dc3a-4693-b077-fb9e0eb9baba None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:49.867856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b84acc-dc3a-4693-b077-fb9e0eb9baba None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:49.872018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b84acc-dc3a-4693-b077-fb9e0eb9baba None admin] PATH_INFO: `/v3/projects/service` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:49.874571 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b84acc-dc3a-4693-b077-fb9e0eb9baba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:49.876029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b84acc-dc3a-4693-b077-fb9e0eb9baba None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-11b84acc-dc3a-4693-b077-fb9e0eb9baba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:23:49.889511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:49.890651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:49.891829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:23:49.891829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:23:49.891829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:23:49.891829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:23:49.891829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:23:49.891829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:23:49.891829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:49.891829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:49.891829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 632/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:49.896491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc90872-5228-4658-a79e-0dfe9cdeb0a9 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:49.994563 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc90872-5228-4658-a79e-0dfe9cdeb0a9 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:50.026741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a6dff-1b0a-4a76-acd8-370c029d40ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:50.027461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6dff-1b0a-4a76-acd8-370c029d40ff None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:50.027680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6dff-1b0a-4a76-acd8-370c029d40ff None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:50.032040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6dff-1b0a-4a76-acd8-370c029d40ff None admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:50.032040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a6dff-1b0a-4a76-acd8-370c029d40ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:50.032040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a6dff-1b0a-4a76-acd8-370c029d40ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:50.032040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a6dff-1b0a-4a76-acd8-370c029d40ff None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:50.043042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 627/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:50.049058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b84acc-dc3a-4693-b077-fb9e0eb9baba None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:50.074488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:50.146477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b84acc-dc3a-4693-b077-fb9e0eb9baba None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:50.179149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803000e6-f250-4717-8268-466cb0e2ba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:50.179813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803000e6-f250-4717-8268-466cb0e2ba20 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:50.180093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803000e6-f250-4717-8268-466cb0e2ba20 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:50.180365 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803000e6-f250-4717-8268-466cb0e2ba20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:50.181177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803000e6-f250-4717-8268-466cb0e2ba20 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=b2e57a7647d143f5835225616138827e) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:50.181482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803000e6-f250-4717-8268-466cb0e2ba20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:50.182890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803000e6-f250-4717-8268-466cb0e2ba20 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:50.188117 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 633/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:23:50 2022] GET /identity/v3/role_assignments?user.id=b2e57a7647d143f5835225616138827e&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=635caa85d8524fb887206fd521defd3f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:52.264965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381959d1-cfe7-4db1-9db4-d936ab00e98b None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:52.265511 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381959d1-cfe7-4db1-9db4-d936ab00e98b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:52.265616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381959d1-cfe7-4db1-9db4-d936ab00e98b None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:52.266910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 628/1261] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:52.271998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d5acd-f90f-42d6-9d6f-cfa52ad441c1 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:52.272415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d5acd-f90f-42d6-9d6f-cfa52ad441c1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:52.272559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d5acd-f90f-42d6-9d6f-cfa52ad441c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:52.289343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3f7d5acd-f90f-42d6-9d6f-cfa52ad441c1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:52.290532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3f7d5acd-f90f-42d6-9d6f-cfa52ad441c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:52.356386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 634/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:23:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:23:52.378898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381959d1-cfe7-4db1-9db4-d936ab00e98b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:52.389899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:52.477641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381959d1-cfe7-4db1-9db4-d936ab00e98b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:52.514278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cee6e4-7f04-4a6a-9240-0dd3f302e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:52.515065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cee6e4-7f04-4a6a-9240-0dd3f302e99c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:52.515350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cee6e4-7f04-4a6a-9240-0dd3f302e99c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:52.515628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cee6e4-7f04-4a6a-9240-0dd3f302e99c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:52.526077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cee6e4-7f04-4a6a-9240-0dd3f302e99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-b4cee6e4-7f04-4a6a-9240-0dd3f302e99c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:23:52.533772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:52.534852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:52.536172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 629/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:23:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:52.541822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d5acd-f90f-42d6-9d6f-cfa52ad441c1 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:52.560103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:52.636628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d5acd-f90f-42d6-9d6f-cfa52ad441c1 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:52.670834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65050-478c-4c62-affd-a31be44fb31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:52.671499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65050-478c-4c62-affd-a31be44fb31b None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:52.671811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65050-478c-4c62-affd-a31be44fb31b None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:52.672086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65050-478c-4c62-affd-a31be44fb31b None admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:52.672971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d65050-478c-4c62-affd-a31be44fb31b None admin] RBAC: Adding query filter params (name=admin) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:52.673276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d65050-478c-4c62-affd-a31be44fb31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:52.674648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d65050-478c-4c62-affd-a31be44fb31b None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:52.683185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 635/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:23:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:52.688906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cee6e4-7f04-4a6a-9240-0dd3f302e99c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:52.753176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:52.786926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cee6e4-7f04-4a6a-9240-0dd3f302e99c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:52.820102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023be01-db9b-4787-b1b1-7183bb8064de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:52.820881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023be01-db9b-4787-b1b1-7183bb8064de None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:52.821160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023be01-db9b-4787-b1b1-7183bb8064de None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:52.821432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023be01-db9b-4787-b1b1-7183bb8064de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:52.831516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023be01-db9b-4787-b1b1-7183bb8064de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:52.833006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023be01-db9b-4787-b1b1-7183bb8064de None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-9023be01-db9b-4787-b1b1-7183bb8064de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:52.849883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:52.850897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:52.851868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:52.851868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:52.851868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:52.851868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:52.851868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 630/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:52.856753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65050-478c-4c62-affd-a31be44fb31b None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:52.933771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:52.952052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65050-478c-4c62-affd-a31be44fb31b None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:52.984863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf94563-d2d5-42c6-a32c-327031e50cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:52.985517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94563-d2d5-42c6-a32c-327031e50cdb None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:52.985794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94563-d2d5-42c6-a32c-327031e50cdb None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:52.986066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94563-d2d5-42c6-a32c-327031e50cdb None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:52.986767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf94563-d2d5-42c6-a32c-327031e50cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:52.987070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf94563-d2d5-42c6-a32c-327031e50cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:52.988446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf94563-d2d5-42c6-a32c-327031e50cdb None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:52.999342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 636/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:53.004801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023be01-db9b-4787-b1b1-7183bb8064de None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:53.105555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023be01-db9b-4787-b1b1-7183bb8064de None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:53.124883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:53.138958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c3c34-eacc-430b-8059-3e797afadcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:53.139778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c3c34-eacc-430b-8059-3e797afadcb9 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:53.140065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c3c34-eacc-430b-8059-3e797afadcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:53.140341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c3c34-eacc-430b-8059-3e797afadcb9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:53.147547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c3c34-eacc-430b-8059-3e797afadcb9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:53.149017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c3c34-eacc-430b-8059-3e797afadcb9 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-210c3c34-eacc-430b-8059-3e797afadcb9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:23:53.163350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:53.164431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:53.165414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 631/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:53.170463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf94563-d2d5-42c6-a32c-327031e50cdb None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:53.270461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf94563-d2d5-42c6-a32c-327031e50cdb None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:53.303208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e23cf-59ff-4add-a00e-654b84b63190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:53.303891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e23cf-59ff-4add-a00e-654b84b63190 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:53.304173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e23cf-59ff-4add-a00e-654b84b63190 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:53.304449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e23cf-59ff-4add-a00e-654b84b63190 None admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:53.305265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e23cf-59ff-4add-a00e-654b84b63190 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:53.305575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e23cf-59ff-4add-a00e-654b84b63190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:53.307031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e23cf-59ff-4add-a00e-654b84b63190 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:53.315845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:53.324295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 637/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 16 00:23:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:53.330149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c3c34-eacc-430b-8059-3e797afadcb9 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:53.427488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c3c34-eacc-430b-8059-3e797afadcb9 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:53.461053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5af936-3623-4709-ba96-d32c34c00685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:53.462534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5af936-3623-4709-ba96-d32c34c00685 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:53.462534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5af936-3623-4709-ba96-d32c34c00685 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:53.462534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5af936-3623-4709-ba96-d32c34c00685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:53.473251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5af936-3623-4709-ba96-d32c34c00685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:53.475227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5af936-3623-4709-ba96-d32c34c00685 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-4e5af936-3623-4709-ba96-d32c34c00685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:53.492524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:53.493570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:53.499625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:53.499625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:53.499625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:53.499625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:53.499625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 632/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:53.500007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e23cf-59ff-4add-a00e-654b84b63190 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:53.597494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e23cf-59ff-4add-a00e-654b84b63190 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:53.631014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b963db-c5be-45b2-876b-b602569f3c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:53.631994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b963db-c5be-45b2-876b-b602569f3c7d None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:53.632247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b963db-c5be-45b2-876b-b602569f3c7d None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:53.632523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b963db-c5be-45b2-876b-b602569f3c7d None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:53.633225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b963db-c5be-45b2-876b-b602569f3c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:53.633530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b963db-c5be-45b2-876b-b602569f3c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:53.634899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b963db-c5be-45b2-876b-b602569f3c7d None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:53.646029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 638/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:53.651717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5af936-3623-4709-ba96-d32c34c00685 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:53.683451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:53.748691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5af936-3623-4709-ba96-d32c34c00685 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:53.782677 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c43315-d1bb-4fe0-ac15-5d6e15976196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:53.783455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c43315-d1bb-4fe0-ac15-5d6e15976196 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:53.783875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c43315-d1bb-4fe0-ac15-5d6e15976196 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:53.784155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c43315-d1bb-4fe0-ac15-5d6e15976196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:53.791166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c43315-d1bb-4fe0-ac15-5d6e15976196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:53.792828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c43315-d1bb-4fe0-ac15-5d6e15976196 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-f5c43315-d1bb-4fe0-ac15-5d6e15976196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:23:53.806609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:53.807633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:53.808764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:23:53.808764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:23:53.808764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:23:53.808764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:23:53.808764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:23:53.808764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:23:53.808764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:53.808764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:53.808764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 633/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:53.814123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b963db-c5be-45b2-876b-b602569f3c7d None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:53.873971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:53.913363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b963db-c5be-45b2-876b-b602569f3c7d None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:53.947619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a17c0-2c91-4873-af07-2d65c059b0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:53.948297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a17c0-2c91-4873-af07-2d65c059b0c2 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:53.948581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a17c0-2c91-4873-af07-2d65c059b0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:53.948857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a17c0-2c91-4873-af07-2d65c059b0c2 None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:53.949631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a17c0-2c91-4873-af07-2d65c059b0c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:53.949941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a17c0-2c91-4873-af07-2d65c059b0c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:53.951675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a17c0-2c91-4873-af07-2d65c059b0c2 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:53.963971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 639/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:53.969999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c43315-d1bb-4fe0-ac15-5d6e15976196 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:54.059894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:54.068716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c43315-d1bb-4fe0-ac15-5d6e15976196 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:54.101331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4871e-e1e7-49a6-8929-4f549f9a1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:54.102201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4871e-e1e7-49a6-8929-4f549f9a1bb2 None admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:54.102479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4871e-e1e7-49a6-8929-4f549f9a1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:54.102750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4871e-e1e7-49a6-8929-4f549f9a1bb2 None admin] PATH_INFO: `/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/b2e57a7647d143f5835225616138827e/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:54.104697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4871e-e1e7-49a6-8929-4f549f9a1bb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c32b0c270c2427799bc5b3255db1f6c, user_id=b2e57a7647d143f5835225616138827e, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:54.106122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4871e-e1e7-49a6-8929-4f549f9a1bb2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:54.211143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 634/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 16 00:23:53 2022] PUT /identity/v3/projects/4c32b0c270c2427799bc5b3255db1f6c/users/b2e57a7647d143f5835225616138827e/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:23:56.315619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6bfdc-bc80-4bf5-bc8e-c2d1c9bc0779 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:56.316250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6bfdc-bc80-4bf5-bc8e-c2d1c9bc0779 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:56.316250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6bfdc-bc80-4bf5-bc8e-c2d1c9bc0779 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:56.318155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 640/1274] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:56.323433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbaf31-ab09-4ebb-b43a-00c50b1e4dc5 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:56.323997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbaf31-ab09-4ebb-b43a-00c50b1e4dc5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:56.323997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbaf31-ab09-4ebb-b43a-00c50b1e4dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:56.339925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-becbaf31-ab09-4ebb-b43a-00c50b1e4dc5 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:56.341113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-becbaf31-ab09-4ebb-b43a-00c50b1e4dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:56.405132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 635/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:23:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:23:56.429249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6bfdc-bc80-4bf5-bc8e-c2d1c9bc0779 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:56.527950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6bfdc-bc80-4bf5-bc8e-c2d1c9bc0779 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:56.546368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:56.563040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736423ba-2d65-48cc-9123-cac3040f4b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:56.563850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736423ba-2d65-48cc-9123-cac3040f4b38 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:56.564136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736423ba-2d65-48cc-9123-cac3040f4b38 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:56.564412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736423ba-2d65-48cc-9123-cac3040f4b38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:56.574500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736423ba-2d65-48cc-9123-cac3040f4b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-736423ba-2d65-48cc-9123-cac3040f4b38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:23:56.582309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:56.583428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:56.584675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 641/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 16 00:23:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:56.589439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbaf31-ab09-4ebb-b43a-00c50b1e4dc5 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:56.668683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:56.686235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbaf31-ab09-4ebb-b43a-00c50b1e4dc5 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:56.717830 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fadbb7-b2a7-41ab-a268-72b292c827ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:56.718484 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fadbb7-b2a7-41ab-a268-72b292c827ec None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:56.718762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fadbb7-b2a7-41ab-a268-72b292c827ec None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:56.719036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fadbb7-b2a7-41ab-a268-72b292c827ec None admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:56.719780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fadbb7-b2a7-41ab-a268-72b292c827ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:56.720086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fadbb7-b2a7-41ab-a268-72b292c827ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:56.721444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fadbb7-b2a7-41ab-a268-72b292c827ec None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:56.730187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 636/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 16 00:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:56.735458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736423ba-2d65-48cc-9123-cac3040f4b38 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:56.831926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736423ba-2d65-48cc-9123-cac3040f4b38 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:56.873053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0d7e-b5ed-4737-8467-60198f4512ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:56.873840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0d7e-b5ed-4737-8467-60198f4512ec None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:56.874120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0d7e-b5ed-4737-8467-60198f4512ec None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:56.874396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0d7e-b5ed-4737-8467-60198f4512ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:56.885118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e0d7e-b5ed-4737-8467-60198f4512ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:56.886566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e0d7e-b5ed-4737-8467-60198f4512ec None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-051e0d7e-b5ed-4737-8467-60198f4512ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:56.903627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:56.904673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:56.905540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:56.905540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:56.905540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:56.905540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:56.905540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 642/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:56.910668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fadbb7-b2a7-41ab-a268-72b292c827ec None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:57.006492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fadbb7-b2a7-41ab-a268-72b292c827ec None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:57.040200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654841e3-9afb-4680-9243-3860641d6700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:57.040998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654841e3-9afb-4680-9243-3860641d6700 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:57.041132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654841e3-9afb-4680-9243-3860641d6700 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:57.041409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654841e3-9afb-4680-9243-3860641d6700 None admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:57.042120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654841e3-9afb-4680-9243-3860641d6700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:57.042427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654841e3-9afb-4680-9243-3860641d6700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:57.043823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654841e3-9afb-4680-9243-3860641d6700 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:57.055422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 637/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:57.061676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0d7e-b5ed-4737-8467-60198f4512ec None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:57.092803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:57.161933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0d7e-b5ed-4737-8467-60198f4512ec None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:57.195166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f774fc-e218-444d-a346-4d3875aa2f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:57.195985 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f774fc-e218-444d-a346-4d3875aa2f5f None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:57.196272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f774fc-e218-444d-a346-4d3875aa2f5f None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:57.196551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f774fc-e218-444d-a346-4d3875aa2f5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:57.204087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f774fc-e218-444d-a346-4d3875aa2f5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:57.205525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f774fc-e218-444d-a346-4d3875aa2f5f None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-31f774fc-e218-444d-a346-4d3875aa2f5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:23:57.220738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:57.225252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:23:57.226216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 643/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:57.228749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654841e3-9afb-4680-9243-3860641d6700 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:57.232630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:57.326169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654841e3-9afb-4680-9243-3860641d6700 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:57.359371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c3d7e-07ee-473e-bb26-e867412279f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:57.359994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c3d7e-07ee-473e-bb26-e867412279f6 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:57.360275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c3d7e-07ee-473e-bb26-e867412279f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:57.360549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c3d7e-07ee-473e-bb26-e867412279f6 None admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:57.361364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c3d7e-07ee-473e-bb26-e867412279f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:57.361670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c3d7e-07ee-473e-bb26-e867412279f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:57.363094 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c3d7e-07ee-473e-bb26-e867412279f6 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:57.380440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 638/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 16 00:23:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:57.386484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f774fc-e218-444d-a346-4d3875aa2f5f None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:57.475886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:57.485010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f774fc-e218-444d-a346-4d3875aa2f5f None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:57.517471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52393c2-4b55-487a-972d-f1141e1096a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:57.518114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52393c2-4b55-487a-972d-f1141e1096a6 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:57.518517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52393c2-4b55-487a-972d-f1141e1096a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:57.518792 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52393c2-4b55-487a-972d-f1141e1096a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:57.584314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52393c2-4b55-487a-972d-f1141e1096a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:57.585770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52393c2-4b55-487a-972d-f1141e1096a6 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:57.671330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:57.681565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 644/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 16 00:23:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:23:57.687656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c3d7e-07ee-473e-bb26-e867412279f6 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:57.746889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:57.783786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c3d7e-07ee-473e-bb26-e867412279f6 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:57.817043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59dc30-9c63-4039-acc8-6c1ebccf224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:57.818460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59dc30-9c63-4039-acc8-6c1ebccf224c None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:57.818744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59dc30-9c63-4039-acc8-6c1ebccf224c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:57.819018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59dc30-9c63-4039-acc8-6c1ebccf224c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:57.828849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59dc30-9c63-4039-acc8-6c1ebccf224c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:57.830805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59dc30-9c63-4039-acc8-6c1ebccf224c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-2f59dc30-9c63-4039-acc8-6c1ebccf224c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:23:57.848206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:57.849274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:57.850433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:23:57.850433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:23:57.850433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:23:57.850433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:57.850433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 639/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:23:57.855147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52393c2-4b55-487a-972d-f1141e1096a6 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:57.951129 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52393c2-4b55-487a-972d-f1141e1096a6 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:57.984003 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd18f4-dea5-4047-bd17-2f97960851ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:57.984655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd18f4-dea5-4047-bd17-2f97960851ce None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:57.984944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd18f4-dea5-4047-bd17-2f97960851ce None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:57.985221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd18f4-dea5-4047-bd17-2f97960851ce None admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:57.985924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd18f4-dea5-4047-bd17-2f97960851ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:57.986230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd18f4-dea5-4047-bd17-2f97960851ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:57.987591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd18f4-dea5-4047-bd17-2f97960851ce None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:57.999187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 645/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 16 00:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:58.004858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59dc30-9c63-4039-acc8-6c1ebccf224c None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:58.108602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59dc30-9c63-4039-acc8-6c1ebccf224c None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:58.123154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:58.142286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2c59-1baa-4876-9d32-274211c1addf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:58.143076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2c59-1baa-4876-9d32-274211c1addf None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:58.143356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2c59-1baa-4876-9d32-274211c1addf None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:58.143628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2c59-1baa-4876-9d32-274211c1addf None admin] PATH_INFO: `/v3/projects/service` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:58.150007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c2c59-1baa-4876-9d32-274211c1addf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:58.151441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c2c59-1baa-4876-9d32-274211c1addf None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application [None req-bf3c2c59-1baa-4876-9d32-274211c1addf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:23:58.165709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application with Lock( Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:23:58.166738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:23:58.168085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:23:58.168085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:23:58.168085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:23:58.168085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:23:58.168085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:23:58.168085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:23:58.168085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:23:58.168085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: ERROR keystone.server.flask.application Jun 16 00:23:58.168085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 640/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 16 00:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:23:58.172722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd18f4-dea5-4047-bd17-2f97960851ce None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:58.220898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:58.270065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd18f4-dea5-4047-bd17-2f97960851ce None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:58.302739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b9624-b0e6-4f47-8944-87b28364aede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:58.303387 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b9624-b0e6-4f47-8944-87b28364aede None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:58.303671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b9624-b0e6-4f47-8944-87b28364aede None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:58.303974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b9624-b0e6-4f47-8944-87b28364aede None admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:58.304750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b9624-b0e6-4f47-8944-87b28364aede None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:58.305056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b9624-b0e6-4f47-8944-87b28364aede None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:58.306476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b9624-b0e6-4f47-8944-87b28364aede None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:58.318708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 646/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 16 00:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:58.324839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2c59-1baa-4876-9d32-274211c1addf None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:58.423263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2c59-1baa-4876-9d32-274211c1addf None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:58.455866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec49234-210d-47bd-9ef1-2cdb757cceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:58.456506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec49234-210d-47bd-9ef1-2cdb757cceb2 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:58.456790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec49234-210d-47bd-9ef1-2cdb757cceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:58.457069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec49234-210d-47bd-9ef1-2cdb757cceb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:58.458422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec49234-210d-47bd-9ef1-2cdb757cceb2 None admin] RBAC: Adding query filter params (role.id=635caa85d8524fb887206fd521defd3f, scope.project.id=4c32b0c270c2427799bc5b3255db1f6c, user.id=b2e57a7647d143f5835225616138827e) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:58.458734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec49234-210d-47bd-9ef1-2cdb757cceb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:58.460207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec49234-210d-47bd-9ef1-2cdb757cceb2 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:58.465918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 641/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 16 00:23:58 2022] GET /identity/v3/role_assignments?user.id=b2e57a7647d143f5835225616138827e&scope.project.id=4c32b0c270c2427799bc5b3255db1f6c&role.id=635caa85d8524fb887206fd521defd3f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:00.587430 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c30d6d-7984-4331-b8d5-81eeee632e0c None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:00.588035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c30d6d-7984-4331-b8d5-81eeee632e0c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:00.588035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c30d6d-7984-4331-b8d5-81eeee632e0c None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:00.589379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 647/1288] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:00.594774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e009ae-9a2c-4a8a-943f-400118909dcb None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:00.595164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e009ae-9a2c-4a8a-943f-400118909dcb None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:00.595344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e009ae-9a2c-4a8a-943f-400118909dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:00.612280 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e2e009ae-9a2c-4a8a-943f-400118909dcb None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:00.613462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e2e009ae-9a2c-4a8a-943f-400118909dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:00.642798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:00.678660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 642/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:24:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:24:00.700476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c30d6d-7984-4331-b8d5-81eeee632e0c None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:00.799134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c30d6d-7984-4331-b8d5-81eeee632e0c None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:00.809629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:00.831632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80443f75-9e7e-4189-90f6-f035de0111b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:00.832442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80443f75-9e7e-4189-90f6-f035de0111b1 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:00.833227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80443f75-9e7e-4189-90f6-f035de0111b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:00.833543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80443f75-9e7e-4189-90f6-f035de0111b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:00.834179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80443f75-9e7e-4189-90f6-f035de0111b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:00.835531 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80443f75-9e7e-4189-90f6-f035de0111b1 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-80443f75-9e7e-4189-90f6-f035de0111b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:24:00.847181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:24:00.848322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:24:00.849765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 648/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:24:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:24:00.856824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e009ae-9a2c-4a8a-943f-400118909dcb None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:00.950702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e009ae-9a2c-4a8a-943f-400118909dcb None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:00.983381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8f66-193b-4476-84c2-97736f4fa939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:00.984057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8f66-193b-4476-84c2-97736f4fa939 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:00.984339 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8f66-193b-4476-84c2-97736f4fa939 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:00.984612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8f66-193b-4476-84c2-97736f4fa939 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:00.985297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8f66-193b-4476-84c2-97736f4fa939 None admin] RBAC: Adding query filter params (name=placement) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:00.985599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8f66-193b-4476-84c2-97736f4fa939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:00.986972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8f66-193b-4476-84c2-97736f4fa939 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:00.991683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 643/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jun 16 00:24:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:00.997556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80443f75-9e7e-4189-90f6-f035de0111b1 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:01.097746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80443f75-9e7e-4189-90f6-f035de0111b1 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:01.130200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b888205-55dd-4254-bdf2-606b233853ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:01.130857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b888205-55dd-4254-bdf2-606b233853ca None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:01.131144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b888205-55dd-4254-bdf2-606b233853ca None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:01.134817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b888205-55dd-4254-bdf2-606b233853ca None admin] PATH_INFO: `/v3/services` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:01.134817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b888205-55dd-4254-bdf2-606b233853ca None admin] RBAC: Adding query filter params (type=placement) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:01.134817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b888205-55dd-4254-bdf2-606b233853ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:01.134817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b888205-55dd-4254-bdf2-606b233853ca None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:01.138371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 649/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jun 16 00:24:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:03.199344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e625-05d6-4c56-83d5-cc8942cdc987 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:03.199912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e625-05d6-4c56-83d5-cc8942cdc987 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:03.200001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e625-05d6-4c56-83d5-cc8942cdc987 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:03.201339 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 644/1293] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:03.206536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa418-ffee-442a-9251-b586ae5a8a03 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:03.207699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa418-ffee-442a-9251-b586ae5a8a03 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:03.207699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa418-ffee-442a-9251-b586ae5a8a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:03.223968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-e08aa418-ffee-442a-9251-b586ae5a8a03 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:03.225127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e08aa418-ffee-442a-9251-b586ae5a8a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:03.253504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:03.288857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 650/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:24:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:24:03.312059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e625-05d6-4c56-83d5-cc8942cdc987 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:03.342175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:03.409910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e625-05d6-4c56-83d5-cc8942cdc987 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:03.443666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d853f-3b65-443a-87ce-3c5026bcf44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:03.444345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d853f-3b65-443a-87ce-3c5026bcf44c None admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:03.444626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d853f-3b65-443a-87ce-3c5026bcf44c None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:03.444903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d853f-3b65-443a-87ce-3c5026bcf44c None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:03.445613 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d853f-3b65-443a-87ce-3c5026bcf44c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:03.447024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d853f-3b65-443a-87ce-3c5026bcf44c None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:03.523025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 645/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 16 00:24:03 2022] POST /identity/v3/services => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:05.618799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03b753-4eee-4d8d-b2a3-03ff42c9c742 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:05.619336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03b753-4eee-4d8d-b2a3-03ff42c9c742 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:05.619452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03b753-4eee-4d8d-b2a3-03ff42c9c742 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:05.620814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 651/1296] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:05.626111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65661383-5102-4b12-9418-f1c495c20c70 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:05.630072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65661383-5102-4b12-9418-f1c495c20c70 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:05.630072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65661383-5102-4b12-9418-f1c495c20c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:05.643659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-65661383-5102-4b12-9418-f1c495c20c70 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:05.644859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-65661383-5102-4b12-9418-f1c495c20c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:05.716348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 646/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:24:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:24:05.738636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03b753-4eee-4d8d-b2a3-03ff42c9c742 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:05.838282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03b753-4eee-4d8d-b2a3-03ff42c9c742 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:05.871333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939710ed-c60f-49c7-be9a-a1df8ae8c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:05.872078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939710ed-c60f-49c7-be9a-a1df8ae8c766 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:05.872357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939710ed-c60f-49c7-be9a-a1df8ae8c766 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:05.872627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939710ed-c60f-49c7-be9a-a1df8ae8c766 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:05.873308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939710ed-c60f-49c7-be9a-a1df8ae8c766 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:05.874659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939710ed-c60f-49c7-be9a-a1df8ae8c766 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-939710ed-c60f-49c7-be9a-a1df8ae8c766 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:24:05.887072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:24:05.888248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:24:05.889133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 652/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:24:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:24:05.894192 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65661383-5102-4b12-9418-f1c495c20c70 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:05.911877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:05.988046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65661383-5102-4b12-9418-f1c495c20c70 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:06.022505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963f14f-9405-4396-be71-e31705a3d869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:06.023160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963f14f-9405-4396-be71-e31705a3d869 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:06.023440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963f14f-9405-4396-be71-e31705a3d869 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:06.023716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963f14f-9405-4396-be71-e31705a3d869 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:06.024433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963f14f-9405-4396-be71-e31705a3d869 None admin] RBAC: Adding query filter params (name=placement) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:06.024737 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963f14f-9405-4396-be71-e31705a3d869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:06.026134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963f14f-9405-4396-be71-e31705a3d869 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:06.031319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 647/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jun 16 00:24:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:06.037231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939710ed-c60f-49c7-be9a-a1df8ae8c766 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:06.068661 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:06.133996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939710ed-c60f-49c7-be9a-a1df8ae8c766 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:06.167495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f77cd-5317-4f01-8ec4-b16af11c9ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:06.168159 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f77cd-5317-4f01-8ec4-b16af11c9ea0 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:06.168441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f77cd-5317-4f01-8ec4-b16af11c9ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:06.168732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f77cd-5317-4f01-8ec4-b16af11c9ea0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:06.169486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f77cd-5317-4f01-8ec4-b16af11c9ea0 None admin] RBAC: Adding query filter params (interface=public, service_id=f4dec71885ba4aeb96f962f15104e2e0, region_id=RegionOne) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:06.169797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f77cd-5317-4f01-8ec4-b16af11c9ea0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:06.171140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f77cd-5317-4f01-8ec4-b16af11c9ea0 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:06.176079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 653/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 16 00:24:06 2022] GET /identity/v3/endpoints?service_id=f4dec71885ba4aeb96f962f15104e2e0&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:06.182142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963f14f-9405-4396-be71-e31705a3d869 None admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:06.262536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:06.280600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963f14f-9405-4396-be71-e31705a3d869 None admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:06.313525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63822f13-f713-43f1-a627-c68e31b18e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:06.314180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63822f13-f713-43f1-a627-c68e31b18e14 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:06.314460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63822f13-f713-43f1-a627-c68e31b18e14 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:06.314733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63822f13-f713-43f1-a627-c68e31b18e14 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:06.315403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63822f13-f713-43f1-a627-c68e31b18e14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:06.317381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63822f13-f713-43f1-a627-c68e31b18e14 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:06.324073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 648/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 16 00:24:06 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:08.430244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36620-d415-49ae-a7ab-094788314617 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:08.430778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36620-d415-49ae-a7ab-094788314617 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:08.430891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36620-d415-49ae-a7ab-094788314617 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:08.432348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 654/1302] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:08.437525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c062e3-266c-4160-b3a9-39ceb2d18459 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:08.437936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c062e3-266c-4160-b3a9-39ceb2d18459 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:08.438072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c062e3-266c-4160-b3a9-39ceb2d18459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:08.455166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d9c062e3-266c-4160-b3a9-39ceb2d18459 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:08.456511 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d9c062e3-266c-4160-b3a9-39ceb2d18459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:08.521771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 649/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:24:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:24:08.545324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e36620-d415-49ae-a7ab-094788314617 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:08.638203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:08.644609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e36620-d415-49ae-a7ab-094788314617 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:08.677183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b6540-9fdc-40f0-905c-5be390f8f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:08.677974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b6540-9fdc-40f0-905c-5be390f8f428 None admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:08.678254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b6540-9fdc-40f0-905c-5be390f8f428 None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:08.678528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b6540-9fdc-40f0-905c-5be390f8f428 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:08.679169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b6540-9fdc-40f0-905c-5be390f8f428 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:08.680601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b6540-9fdc-40f0-905c-5be390f8f428 None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application [None req-0a2b6540-9fdc-40f0-905c-5be390f8f428 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:24:08.693070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:24:08.694166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application with Lock( Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: ERROR keystone.server.flask.application Jun 16 00:24:08.695106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 655/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 16 00:24:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:24:08.700528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c062e3-266c-4160-b3a9-39ceb2d18459 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:08.772744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:08.794356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c062e3-266c-4160-b3a9-39ceb2d18459 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:08.826277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0c5dc-6df9-45f0-b21d-442c37c796d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:08.826921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0c5dc-6df9-45f0-b21d-442c37c796d1 None admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:08.827207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0c5dc-6df9-45f0-b21d-442c37c796d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:08.827482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0c5dc-6df9-45f0-b21d-442c37c796d1 None admin] PATH_INFO: `/v3/services` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:08.828201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0c5dc-6df9-45f0-b21d-442c37c796d1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:08.828504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0c5dc-6df9-45f0-b21d-442c37c796d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:08.829867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0c5dc-6df9-45f0-b21d-442c37c796d1 None admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:08.836095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 650/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jun 16 00:24:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:08.840855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b6540-9fdc-40f0-905c-5be390f8f428 None admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:08.937663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b6540-9fdc-40f0-905c-5be390f8f428 None admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:08.969741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c0376-2566-41ef-a024-5e5ed83539da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:08.970384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c0376-2566-41ef-a024-5e5ed83539da None admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:08.970665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c0376-2566-41ef-a024-5e5ed83539da None admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:08.970944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c0376-2566-41ef-a024-5e5ed83539da None admin] PATH_INFO: `/v3/endpoints` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:08.971666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c0376-2566-41ef-a024-5e5ed83539da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:08.973651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c0376-2566-41ef-a024-5e5ed83539da None admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:09.068662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 656/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 16 00:24:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:18.835885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=30 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:19.064022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:33.797051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8ab07-46d8-4a03-b494-3d7370ef85d4 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:33.797581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8ab07-46d8-4a03-b494-3d7370ef85d4 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:33.797581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8ab07-46d8-4a03-b494-3d7370ef85d4 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:33.804063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee88aef-08f9-43d9-9467-9fd73e5ba42c None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:33.810690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee88aef-08f9-43d9-9467-9fd73e5ba42c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:33.810690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee88aef-08f9-43d9-9467-9fd73e5ba42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:33.810864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 651/1307] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:31:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:33.902947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-cee88aef-08f9-43d9-9467-9fd73e5ba42c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:33.904813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-cee88aef-08f9-43d9-9467-9fd73e5ba42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:34.096902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 657/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:34.164762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e21368-2f1e-480d-8fde-fc0523cf9283 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:34.165686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e21368-2f1e-480d-8fde-fc0523cf9283 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:34.166110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e21368-2f1e-480d-8fde-fc0523cf9283 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:34.167992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 652/1309] 10.222.0.27 () {54 vars in 964 bytes} [Thu Jun 16 00:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:34.174012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323749f-9e8c-4253-baa3-fc460fa7f398 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:34.174388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323749f-9e8c-4253-baa3-fc460fa7f398 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:34.174743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323749f-9e8c-4253-baa3-fc460fa7f398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:34.271416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d323749f-9e8c-4253-baa3-fc460fa7f398 None None] MFA Rules not processed for user `20b4902b340a4260a0b5f716c3ae9acf`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:34.273159 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d323749f-9e8c-4253-baa3-fc460fa7f398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:34.302020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:34.367880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 658/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Jun 16 00:31:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:34.376803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e21368-2f1e-480d-8fde-fc0523cf9283 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:34.378508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-05e21368-2f1e-480d-8fde-fc0523cf9283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:34.500357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e21368-2f1e-480d-8fde-fc0523cf9283 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:34.584071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d4bd-f896-47d4-a38c-9062ed1c6814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:34.584965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d4bd-f896-47d4-a38c-9062ed1c6814 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:34.585247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d4bd-f896-47d4-a38c-9062ed1c6814 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:34.585632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d4bd-f896-47d4-a38c-9062ed1c6814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:34.587285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b9d0d4bd-f896-47d4-a38c-9062ed1c6814 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:34.647417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:34.705499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0d4bd-f896-47d4-a38c-9062ed1c6814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:34.707136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0d4bd-f896-47d4-a38c-9062ed1c6814 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:34.730802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 653/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:37.150322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5c4f-86e4-427c-adbb-199f25b9ecbd None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:37.150858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5c4f-86e4-427c-adbb-199f25b9ecbd None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:37.150858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5c4f-86e4-427c-adbb-199f25b9ecbd None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:37.152233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 659/1312] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:37.157338 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451477f2-1e31-4a77-965e-a5da61591ac7 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:37.157729 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451477f2-1e31-4a77-965e-a5da61591ac7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:37.157889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451477f2-1e31-4a77-965e-a5da61591ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:37.227419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-451477f2-1e31-4a77-965e-a5da61591ac7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:37.228669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-451477f2-1e31-4a77-965e-a5da61591ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:37.333911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 654/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:37.372071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f5c4f-86e4-427c-adbb-199f25b9ecbd None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:37.373628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ce7f5c4f-86e4-427c-adbb-199f25b9ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:37.482337 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f5c4f-86e4-427c-adbb-199f25b9ecbd None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:37.555934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:37.558253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71471f4-7eac-4844-a5b7-695976373506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:37.558893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71471f4-7eac-4844-a5b7-695976373506 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:37.559171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71471f4-7eac-4844-a5b7-695976373506 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:37.559441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71471f4-7eac-4844-a5b7-695976373506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:37.561172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b71471f4-7eac-4844-a5b7-695976373506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:37.668286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71471f4-7eac-4844-a5b7-695976373506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:37.669755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71471f4-7eac-4844-a5b7-695976373506 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:37.688694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 660/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:40.502030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef079-9da2-43e2-ba1c-2742985f78e6 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.502564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef079-9da2-43e2-ba1c-2742985f78e6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.502660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef079-9da2-43e2-ba1c-2742985f78e6 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.504013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 655/1315] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:40.509649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2926ac-77a7-464c-810e-385f8944e22e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.510293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2926ac-77a7-464c-810e-385f8944e22e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.510470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2926ac-77a7-464c-810e-385f8944e22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.573290 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-1c2926ac-77a7-464c-810e-385f8944e22e None None] MFA Rules not processed for user `eaba8e0151814990a7ea9b84d6461ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:40.574490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1c2926ac-77a7-464c-810e-385f8944e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:40.625705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:40.668999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 661/1316] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:31:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:40.708516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef079-9da2-43e2-ba1c-2742985f78e6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.710212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7ffef079-9da2-43e2-ba1c-2742985f78e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:40.719978 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:40.814623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef079-9da2-43e2-ba1c-2742985f78e6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.891032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249ce2-6f32-4502-8bc5-af6c36e574dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.891680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249ce2-6f32-4502-8bc5-af6c36e574dc service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.891993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249ce2-6f32-4502-8bc5-af6c36e574dc service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.892272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249ce2-6f32-4502-8bc5-af6c36e574dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.893907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ee249ce2-6f32-4502-8bc5-af6c36e574dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:40.956019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:41.003298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee249ce2-6f32-4502-8bc5-af6c36e574dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:41.004913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee249ce2-6f32-4502-8bc5-af6c36e574dc service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:41.023805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 656/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:44.233262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4c771-ea2e-4fd1-8178-30a390dd5089 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:44.233790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4c771-ea2e-4fd1-8178-30a390dd5089 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:44.233790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4c771-ea2e-4fd1-8178-30a390dd5089 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:44.235182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 662/1318] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:44.240364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-added567-2eec-42b3-8f6d-110924cc0325 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:44.240771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-added567-2eec-42b3-8f6d-110924cc0325 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:44.240930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-added567-2eec-42b3-8f6d-110924cc0325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:44.309394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-added567-2eec-42b3-8f6d-110924cc0325 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:44.310528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-added567-2eec-42b3-8f6d-110924cc0325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:44.405528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 657/1319] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:31:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:44.442822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4c771-ea2e-4fd1-8178-30a390dd5089 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:44.444938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a9b4c771-ea2e-4fd1-8178-30a390dd5089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:44.546808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4c771-ea2e-4fd1-8178-30a390dd5089 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:44.618780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53783-044c-4c93-8321-54977eee0b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:44.619426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53783-044c-4c93-8321-54977eee0b54 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:44.619709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53783-044c-4c93-8321-54977eee0b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:44.620022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53783-044c-4c93-8321-54977eee0b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:44.621641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8fe53783-044c-4c93-8321-54977eee0b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:44.628418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:44.729554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53783-044c-4c93-8321-54977eee0b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:44.742060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53783-044c-4c93-8321-54977eee0b54 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:44.751471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 663/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:48.076412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777071d-c076-48a7-afd4-b5c37863f5eb None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.076923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777071d-c076-48a7-afd4-b5c37863f5eb None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.077019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777071d-c076-48a7-afd4-b5c37863f5eb None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.078335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 658/1321] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:48.083377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520362d-f878-4a25-8d3d-7333cc8155c3 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.083856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520362d-f878-4a25-8d3d-7333cc8155c3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.084015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520362d-f878-4a25-8d3d-7333cc8155c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.149133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7520362d-f878-4a25-8d3d-7333cc8155c3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:48.171891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7520362d-f878-4a25-8d3d-7333cc8155c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.208399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:48.250158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 664/1322] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:48.286740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777071d-c076-48a7-afd4-b5c37863f5eb None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.288952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b777071d-c076-48a7-afd4-b5c37863f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.310106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:48.399662 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777071d-c076-48a7-afd4-b5c37863f5eb None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.475536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543520-e427-4bec-80cc-3a869ceaa16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.476739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543520-e427-4bec-80cc-3a869ceaa16d service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.477025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543520-e427-4bec-80cc-3a869ceaa16d service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.477301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543520-e427-4bec-80cc-3a869ceaa16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.478943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e3543520-e427-4bec-80cc-3a869ceaa16d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.550676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:48.587956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543520-e427-4bec-80cc-3a869ceaa16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.589435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543520-e427-4bec-80cc-3a869ceaa16d service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.607745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 659/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:50.774663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849520a8-64aa-4079-9764-ca90f187caa7 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.775187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849520a8-64aa-4079-9764-ca90f187caa7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.775187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849520a8-64aa-4079-9764-ca90f187caa7 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.776666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 665/1324] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:50.781577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed994ab-7cbf-42d7-9409-6c3f22f520a8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.781991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed994ab-7cbf-42d7-9409-6c3f22f520a8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.782153 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed994ab-7cbf-42d7-9409-6c3f22f520a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.846536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-2ed994ab-7cbf-42d7-9409-6c3f22f520a8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:50.847774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2ed994ab-7cbf-42d7-9409-6c3f22f520a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:50.942105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 660/1325] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:50.989868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475727cc-f350-4bda-ba0b-aa1f43ea17af None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.990282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475727cc-f350-4bda-ba0b-aa1f43ea17af None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.990634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475727cc-f350-4bda-ba0b-aa1f43ea17af None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.993342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 666/1326] 10.222.0.27 () {54 vars in 964 bytes} [Thu Jun 16 00:31:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:50.999407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3885-e290-49cb-b1bf-8fb8703c5e0d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.999703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3885-e290-49cb-b1bf-8fb8703c5e0d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:51.000016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3885-e290-49cb-b1bf-8fb8703c5e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:51.031554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:51.078519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-251d3885-e290-49cb-b1bf-8fb8703c5e0d None None] MFA Rules not processed for user `20b4902b340a4260a0b5f716c3ae9acf`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:51.080107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-251d3885-e290-49cb-b1bf-8fb8703c5e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:51.156531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 661/1327] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Jun 16 00:31:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:51.166647 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475727cc-f350-4bda-ba0b-aa1f43ea17af None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:51.168405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-475727cc-f350-4bda-ba0b-aa1f43ea17af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:51.273265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475727cc-f350-4bda-ba0b-aa1f43ea17af None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:51.344473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f6c0-9640-42df-97ba-afc81ad797f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:51.345136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f6c0-9640-42df-97ba-afc81ad797f1 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:51.345421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f6c0-9640-42df-97ba-afc81ad797f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:51.345699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f6c0-9640-42df-97ba-afc81ad797f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:51.347440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4882f6c0-9640-42df-97ba-afc81ad797f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:51.374064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:51.469156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882f6c0-9640-42df-97ba-afc81ad797f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:51.470606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882f6c0-9640-42df-97ba-afc81ad797f1 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:51.488869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 667/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:53.872758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7d3af-f64e-4766-a169-bfa2ee02dd2f None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.872758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7d3af-f64e-4766-a169-bfa2ee02dd2f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.872758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7d3af-f64e-4766-a169-bfa2ee02dd2f None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.877583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 662/1329] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:53.879711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c4c15-e4fc-47d1-8914-2f3dca20c217 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.880152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c4c15-e4fc-47d1-8914-2f3dca20c217 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.880230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c4c15-e4fc-47d1-8914-2f3dca20c217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.953750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-381c4c15-e4fc-47d1-8914-2f3dca20c217 None None] MFA Rules not processed for user `eaba8e0151814990a7ea9b84d6461ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:53.954971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-381c4c15-e4fc-47d1-8914-2f3dca20c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:54.023183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:54.054980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 668/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:31:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:54.093124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7d3af-f64e-4766-a169-bfa2ee02dd2f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:54.094642 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f2e7d3af-f64e-4766-a169-bfa2ee02dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:54.211074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7d3af-f64e-4766-a169-bfa2ee02dd2f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:54.230230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:54.285974 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcc012-1934-418e-924d-c5c5e0bd2819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:54.286619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc012-1934-418e-924d-c5c5e0bd2819 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.286902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc012-1934-418e-924d-c5c5e0bd2819 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.287176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc012-1934-418e-924d-c5c5e0bd2819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.288878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-31fcc012-1934-418e-924d-c5c5e0bd2819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:54.394971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcc012-1934-418e-924d-c5c5e0bd2819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:54.396450 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcc012-1934-418e-924d-c5c5e0bd2819 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.414608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 663/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:57.165382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb922d-f40c-4226-9f0c-0f6b4d7297f8 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:57.165930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb922d-f40c-4226-9f0c-0f6b4d7297f8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:57.165930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb922d-f40c-4226-9f0c-0f6b4d7297f8 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:57.167310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 669/1332] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:57.172443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7db78-307b-4c51-aeeb-cc6933ba28ce None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:57.172844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7db78-307b-4c51-aeeb-cc6933ba28ce None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:57.172979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7db78-307b-4c51-aeeb-cc6933ba28ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:57.233442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:57.236038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-16a7db78-307b-4c51-aeeb-cc6933ba28ce None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:57.237222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-16a7db78-307b-4c51-aeeb-cc6933ba28ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:57.330608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 664/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:57.366281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb922d-f40c-4226-9f0c-0f6b4d7297f8 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:57.367835 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1edb922d-f40c-4226-9f0c-0f6b4d7297f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:57.468090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb922d-f40c-4226-9f0c-0f6b4d7297f8 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:57.539492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f27a4a-ed9a-404f-b8b9-81f3f3b74d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:57.540161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27a4a-ed9a-404f-b8b9-81f3f3b74d5d service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:57.540445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27a4a-ed9a-404f-b8b9-81f3f3b74d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:57.540720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27a4a-ed9a-404f-b8b9-81f3f3b74d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:57.542334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-64f27a4a-ed9a-404f-b8b9-81f3f3b74d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:57.568463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:57.649198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f27a4a-ed9a-404f-b8b9-81f3f3b74d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:57.650550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f27a4a-ed9a-404f-b8b9-81f3f3b74d5d service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:57.669377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 670/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:59.835998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55777ca6-e6d1-42de-ade6-44fa415016a6 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:59.836552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55777ca6-e6d1-42de-ade6-44fa415016a6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:59.836552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55777ca6-e6d1-42de-ade6-44fa415016a6 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:59.837949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 665/1335] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:59.843126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c7cc-35a9-4a2c-8da2-29abc149eeb8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:59.843552 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c7cc-35a9-4a2c-8da2-29abc149eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:59.843777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c7cc-35a9-4a2c-8da2-29abc149eeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:59.906097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-14c6c7cc-35a9-4a2c-8da2-29abc149eeb8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:59.907276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-14c6c7cc-35a9-4a2c-8da2-29abc149eeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:59.982848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:00.004723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 671/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:00.044576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55777ca6-e6d1-42de-ade6-44fa415016a6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:00.046093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-55777ca6-e6d1-42de-ade6-44fa415016a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:00.152940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55777ca6-e6d1-42de-ade6-44fa415016a6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:00.181404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:00.226026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ba87-5f57-4c55-ac2e-cd861f151c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:00.227102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ba87-5f57-4c55-ac2e-cd861f151c05 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:00.227382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ba87-5f57-4c55-ac2e-cd861f151c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:00.227653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ba87-5f57-4c55-ac2e-cd861f151c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:00.229287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a604ba87-5f57-4c55-ac2e-cd861f151c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:00.337881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ba87-5f57-4c55-ac2e-cd861f151c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:00.339328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ba87-5f57-4c55-ac2e-cd861f151c05 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:00.357914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 666/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:03.331079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ef87e-5836-432f-942a-ea457153ca98 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:03.331631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ef87e-5836-432f-942a-ea457153ca98 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:03.331631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ef87e-5836-432f-942a-ea457153ca98 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:03.333056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 672/1338] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:03.338815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a301bf-0d50-460b-b7cc-6c9f9adedbcd None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:03.339287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a301bf-0d50-460b-b7cc-6c9f9adedbcd None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:03.339427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a301bf-0d50-460b-b7cc-6c9f9adedbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:03.402676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e6a301bf-0d50-460b-b7cc-6c9f9adedbcd None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:03.403989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e6a301bf-0d50-460b-b7cc-6c9f9adedbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:03.412363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:03.498486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 667/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:03.538154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ef87e-5836-432f-942a-ea457153ca98 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:03.539687 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-632ef87e-5836-432f-942a-ea457153ca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:03.640999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ef87e-5836-432f-942a-ea457153ca98 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:03.712504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc7068-79ae-4557-8571-4bafbb1837fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:03.713141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc7068-79ae-4557-8571-4bafbb1837fc service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:03.713423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc7068-79ae-4557-8571-4bafbb1837fc service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:03.713697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc7068-79ae-4557-8571-4bafbb1837fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:03.715302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-40fc7068-79ae-4557-8571-4bafbb1837fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:03.749242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:03.821559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc7068-79ae-4557-8571-4bafbb1837fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:03.822985 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc7068-79ae-4557-8571-4bafbb1837fc service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:03.840744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 673/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:32:08.268121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0f8bb-b572-4840-8c88-307f8bd2736a None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:08.268657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0f8bb-b572-4840-8c88-307f8bd2736a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:08.268657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0f8bb-b572-4840-8c88-307f8bd2736a None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:08.274495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 668/1341] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:08.277313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9e1bf-8f52-497b-956b-4a81919292d9 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:08.277794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9e1bf-8f52-497b-956b-4a81919292d9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:08.277910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9e1bf-8f52-497b-956b-4a81919292d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:08.354770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-67c9e1bf-8f52-497b-956b-4a81919292d9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:08.356007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-67c9e1bf-8f52-497b-956b-4a81919292d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:08.457506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:08.471243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 674/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:08.510730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0f8bb-b572-4840-8c88-307f8bd2736a None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:08.512866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7fe0f8bb-b572-4840-8c88-307f8bd2736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:08.606736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0f8bb-b572-4840-8c88-307f8bd2736a None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:08.610225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161821ec-98c4-4883-aa7c-8e32a15f365a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:08.610861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161821ec-98c4-4883-aa7c-8e32a15f365a service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:08.611140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161821ec-98c4-4883-aa7c-8e32a15f365a service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:08.611414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161821ec-98c4-4883-aa7c-8e32a15f365a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:08.620292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161821ec-98c4-4883-aa7c-8e32a15f365a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:08.621724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161821ec-98c4-4883-aa7c-8e32a15f365a service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:08.631766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 669/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:11.935807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dadbcf-c988-4a66-9d1c-ab3f0d2082eb None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:11.936321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dadbcf-c988-4a66-9d1c-ab3f0d2082eb None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:11.936321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dadbcf-c988-4a66-9d1c-ab3f0d2082eb None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:11.937662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 675/1344] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:11.942858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7afe0-6cbe-442a-9a1e-748a746005cc None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:11.943867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7afe0-6cbe-442a-9a1e-748a746005cc None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:11.944046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7afe0-6cbe-442a-9a1e-748a746005cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:11.971682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-15c7afe0-6cbe-442a-9a1e-748a746005cc None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:11.972887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-15c7afe0-6cbe-442a-9a1e-748a746005cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:12.000147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:12.049485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 670/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:12.087049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dadbcf-c988-4a66-9d1c-ab3f0d2082eb None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.097712 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dadbcf-c988-4a66-9d1c-ab3f0d2082eb None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.101714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1dd0c-2029-4f00-9ec4-ff38c8bb30cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.102347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1dd0c-2029-4f00-9ec4-ff38c8bb30cc service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.102632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1dd0c-2029-4f00-9ec4-ff38c8bb30cc service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.102909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1dd0c-2029-4f00-9ec4-ff38c8bb30cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.111695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1dd0c-2029-4f00-9ec4-ff38c8bb30cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.113151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1dd0c-2029-4f00-9ec4-ff38c8bb30cc service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.123289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 676/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:16.744104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdce42-d80d-4358-86d3-d4662b233288 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:16.744557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdce42-d80d-4358-86d3-d4662b233288 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:16.744673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdce42-d80d-4358-86d3-d4662b233288 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:16.746058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 671/1347] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:16.751523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e64e-a47f-4eaf-bc75-88b9d4d90663 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:16.752021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e64e-a47f-4eaf-bc75-88b9d4d90663 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:16.752115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e64e-a47f-4eaf-bc75-88b9d4d90663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:16.770563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d2c2e64e-a47f-4eaf-bc75-88b9d4d90663 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:16.772391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d2c2e64e-a47f-4eaf-bc75-88b9d4d90663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:16.780378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 677/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:16.817647 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdce42-d80d-4358-86d3-d4662b233288 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:16.829382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdce42-d80d-4358-86d3-d4662b233288 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:16.833105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033645c-d77b-40d5-9315-e3d280dca7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:16.834334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033645c-d77b-40d5-9315-e3d280dca7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:16.834617 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033645c-d77b-40d5-9315-e3d280dca7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:16.834895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033645c-d77b-40d5-9315-e3d280dca7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:16.844536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033645c-d77b-40d5-9315-e3d280dca7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:16.846007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033645c-d77b-40d5-9315-e3d280dca7b6 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:16.856075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 672/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:21.879353 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f3b4b-913a-4c3f-bc02-e5c6614a6dff None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:21.880334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f3b4b-913a-4c3f-bc02-e5c6614a6dff None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:21.880841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f3b4b-913a-4c3f-bc02-e5c6614a6dff None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:21.882692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 678/1350] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:21.888026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130e1b-d251-4020-9ff1-049d8b01eb4e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:21.888915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130e1b-d251-4020-9ff1-049d8b01eb4e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:21.889414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130e1b-d251-4020-9ff1-049d8b01eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:21.963952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-f3130e1b-d251-4020-9ff1-049d8b01eb4e None None] MFA Rules not processed for user `b2e57a7647d143f5835225616138827e`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:21.965516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f3130e1b-d251-4020-9ff1-049d8b01eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:22.062540 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 673/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:32:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:26.225366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e13dfe-5139-408e-b413-090319c97e1d None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:26.226227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e13dfe-5139-408e-b413-090319c97e1d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:26.226511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e13dfe-5139-408e-b413-090319c97e1d None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:26.228264 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 679/1352] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:26.233206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188a63-363b-46a3-b6ca-ab77a7767e3e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:26.233620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188a63-363b-46a3-b6ca-ab77a7767e3e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:26.233828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188a63-363b-46a3-b6ca-ab77a7767e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:26.252091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-44188a63-363b-46a3-b6ca-ab77a7767e3e None None] MFA Rules not processed for user `b2e57a7647d143f5835225616138827e`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:26.253394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-44188a63-363b-46a3-b6ca-ab77a7767e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:26.262251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 674/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:32:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:26.765183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=13 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:27.774635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa704a4-e66d-4dd5-8fe1-7a3ebbe37848 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:27.775268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa704a4-e66d-4dd5-8fe1-7a3ebbe37848 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:27.775268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa704a4-e66d-4dd5-8fe1-7a3ebbe37848 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:27.776601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 680/1354] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:27.781440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f33397-9d87-441d-ab13-3586ac316f96 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:27.781854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f33397-9d87-441d-ab13-3586ac316f96 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:27.782004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f33397-9d87-441d-ab13-3586ac316f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:27.800765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-19f33397-9d87-441d-ab13-3586ac316f96 None None] MFA Rules not processed for user `b2e57a7647d143f5835225616138827e`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:27.802117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-19f33397-9d87-441d-ab13-3586ac316f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:27.810670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 675/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:32:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:31.571816 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4567-4ad0-4390-b29c-e9f8839ca16c None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:31.572425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4567-4ad0-4390-b29c-e9f8839ca16c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:31.572666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4567-4ad0-4390-b29c-e9f8839ca16c None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:31.574318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 681/1356] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:31.579525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8de398-85f6-45f5-a0a2-7979fe5675d8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:31.579997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8de398-85f6-45f5-a0a2-7979fe5675d8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:31.580135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8de398-85f6-45f5-a0a2-7979fe5675d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:31.599063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4d8de398-85f6-45f5-a0a2-7979fe5675d8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:31.600217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4d8de398-85f6-45f5-a0a2-7979fe5675d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:31.608871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 676/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:31.663931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d0c66-8ff2-4210-b3c2-0b7740257ae7 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:31.664565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d0c66-8ff2-4210-b3c2-0b7740257ae7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:31.665213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d0c66-8ff2-4210-b3c2-0b7740257ae7 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:31.667181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 682/1358] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jun 16 00:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:31.684633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062af7e-c030-41a6-a074-ceaced417bb3 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:31.690832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062af7e-c030-41a6-a074-ceaced417bb3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:31.690832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062af7e-c030-41a6-a074-ceaced417bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:31.734203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:31.744036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a062af7e-c030-41a6-a074-ceaced417bb3 None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:31.748123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a062af7e-c030-41a6-a074-ceaced417bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:31.834172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 677/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jun 16 00:32:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:31.842335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d0c66-8ff2-4210-b3c2-0b7740257ae7 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:31.857582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d0c66-8ff2-4210-b3c2-0b7740257ae7 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:31.863304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4c8d-b894-4b50-b862-10589303c600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:31.864083 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4c8d-b894-4b50-b862-10589303c600 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:31.864964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4c8d-b894-4b50-b862-10589303c600 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:31.865322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4c8d-b894-4b50-b862-10589303c600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:31.874212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4c8d-b894-4b50-b862-10589303c600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:31.875959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4c8d-b894-4b50-b862-10589303c600 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:31.892515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 683/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:34.201430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f991-8035-40b0-8a62-5fe6521d5faa None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:34.201957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f991-8035-40b0-8a62-5fe6521d5faa None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:34.201957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f991-8035-40b0-8a62-5fe6521d5faa None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:34.205099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 678/1361] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:34.209733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e46e-fe5d-4e17-b544-0bc90ccfc210 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:34.210156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e46e-fe5d-4e17-b544-0bc90ccfc210 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:34.210295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e46e-fe5d-4e17-b544-0bc90ccfc210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:34.230473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9594e46e-fe5d-4e17-b544-0bc90ccfc210 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:34.231810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9594e46e-fe5d-4e17-b544-0bc90ccfc210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:34.241103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 684/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:34.290685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917f991-8035-40b0-8a62-5fe6521d5faa None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:34.306307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917f991-8035-40b0-8a62-5fe6521d5faa None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:34.312478 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d247e0-2d21-4d9c-b318-51aa99decb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:34.313165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d247e0-2d21-4d9c-b318-51aa99decb7c service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:34.313455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d247e0-2d21-4d9c-b318-51aa99decb7c service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:34.313755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d247e0-2d21-4d9c-b318-51aa99decb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:34.324465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d247e0-2d21-4d9c-b318-51aa99decb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:34.326367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d247e0-2d21-4d9c-b318-51aa99decb7c service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:34.338267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 679/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:37.000249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6db8fa-71a9-421a-ab67-f6ada35329a7 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:37.000829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6db8fa-71a9-421a-ab67-f6ada35329a7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:37.000829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6db8fa-71a9-421a-ab67-f6ada35329a7 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:37.002213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 685/1364] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:37.008122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a70d-3ba3-41a2-b334-ad70973d5c42 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:37.008545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a70d-3ba3-41a2-b334-ad70973d5c42 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:37.008687 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a70d-3ba3-41a2-b334-ad70973d5c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:37.027409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-fba6a70d-3ba3-41a2-b334-ad70973d5c42 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:37.028650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fba6a70d-3ba3-41a2-b334-ad70973d5c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:37.036863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 680/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:37.083414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a754e-8665-4b89-a8b0-b6704cb8a910 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:37.084251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a754e-8665-4b89-a8b0-b6704cb8a910 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:37.084528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a754e-8665-4b89-a8b0-b6704cb8a910 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:37.086061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 686/1366] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jun 16 00:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:37.091895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4faf4-65ca-43b1-a9dc-33cec3ad58ee None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:37.092259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4faf4-65ca-43b1-a9dc-33cec3ad58ee None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:37.092816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4faf4-65ca-43b1-a9dc-33cec3ad58ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:37.121409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7cd4faf4-65ca-43b1-a9dc-33cec3ad58ee None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:37.122982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7cd4faf4-65ca-43b1-a9dc-33cec3ad58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:37.140196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 681/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jun 16 00:32:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:37.148490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a754e-8665-4b89-a8b0-b6704cb8a910 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:37.163085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a754e-8665-4b89-a8b0-b6704cb8a910 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:37.168870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c6783-3a10-4a95-ac75-f825fad65b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:37.169575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6783-3a10-4a95-ac75-f825fad65b45 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:37.169863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6783-3a10-4a95-ac75-f825fad65b45 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:37.170174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6783-3a10-4a95-ac75-f825fad65b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:37.178503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c6783-3a10-4a95-ac75-f825fad65b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:37.180137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c6783-3a10-4a95-ac75-f825fad65b45 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:37.189806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 687/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:39.570567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e664b-9eec-43cd-8e85-9d849580a546 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:39.571101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e664b-9eec-43cd-8e85-9d849580a546 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:39.571101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e664b-9eec-43cd-8e85-9d849580a546 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:39.572556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 682/1369] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:39.577841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7533d-264e-406f-95cf-ecace7bc368f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:39.578330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7533d-264e-406f-95cf-ecace7bc368f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:39.578411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7533d-264e-406f-95cf-ecace7bc368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:39.596729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0fb7533d-264e-406f-95cf-ecace7bc368f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:39.598226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0fb7533d-264e-406f-95cf-ecace7bc368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:39.606595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 688/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:39.651159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e664b-9eec-43cd-8e85-9d849580a546 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:39.666001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e664b-9eec-43cd-8e85-9d849580a546 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:39.672112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55a1ef-004a-4a9f-9cd0-892c4da83e0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:39.672885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a1ef-004a-4a9f-9cd0-892c4da83e0c service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:39.673262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a1ef-004a-4a9f-9cd0-892c4da83e0c service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:39.673631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55a1ef-004a-4a9f-9cd0-892c4da83e0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:39.683244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55a1ef-004a-4a9f-9cd0-892c4da83e0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:39.685182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55a1ef-004a-4a9f-9cd0-892c4da83e0c service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:39.696299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 683/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:39.777603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef889d2-0d4b-4647-b1ba-d81952690809 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:39.777893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef889d2-0d4b-4647-b1ba-d81952690809 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:39.778171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef889d2-0d4b-4647-b1ba-d81952690809 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:39.779621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 689/1372] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:39.784881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcbccb-ba3f-4ec2-ad97-476e054b0d52 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:39.785172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcbccb-ba3f-4ec2-ad97-476e054b0d52 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:39.785536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcbccb-ba3f-4ec2-ad97-476e054b0d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:39.805451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-02dcbccb-ba3f-4ec2-ad97-476e054b0d52 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:39.805675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-02dcbccb-ba3f-4ec2-ad97-476e054b0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:39.814602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 684/1373] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:40.118708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a7bd0-f2f7-4eeb-97b4-8f0549267d0d None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:40.118708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a7bd0-f2f7-4eeb-97b4-8f0549267d0d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:40.118967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a7bd0-f2f7-4eeb-97b4-8f0549267d0d None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:40.120679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 690/1374] 10.222.0.27 () {54 vars in 963 bytes} [Thu Jun 16 00:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:40.125903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90b5a4-1a2d-4776-8cbc-c6a0e9b37033 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:40.126287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90b5a4-1a2d-4776-8cbc-c6a0e9b37033 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:40.126663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90b5a4-1a2d-4776-8cbc-c6a0e9b37033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:40.178554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5c90b5a4-1a2d-4776-8cbc-c6a0e9b37033 None None] MFA Rules not processed for user `7973be0cfa9846afaef91c7ae1b190d2`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:40.179970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5c90b5a4-1a2d-4776-8cbc-c6a0e9b37033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:40.244231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 685/1375] 10.222.0.27 () {58 vars in 1060 bytes} [Thu Jun 16 00:32:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:40.252345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a7bd0-f2f7-4eeb-97b4-8f0549267d0d None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:40.263893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a7bd0-f2f7-4eeb-97b4-8f0549267d0d None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:40.267467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b46008-cdea-4094-8554-f4be5c33cdcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:40.268234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b46008-cdea-4094-8554-f4be5c33cdcf service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:40.268619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b46008-cdea-4094-8554-f4be5c33cdcf service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:40.269010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b46008-cdea-4094-8554-f4be5c33cdcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:40.278479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b46008-cdea-4094-8554-f4be5c33cdcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:40.280064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b46008-cdea-4094-8554-f4be5c33cdcf service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:40.290105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 691/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:32:42.071553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60ca6f-1103-41c5-9e3f-d584b21db15a None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:42.072367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60ca6f-1103-41c5-9e3f-d584b21db15a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:42.072880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60ca6f-1103-41c5-9e3f-d584b21db15a None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:42.074310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 686/1377] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:42.080261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9350-dadf-495f-b3a3-9878ecfede02 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:42.080856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9350-dadf-495f-b3a3-9878ecfede02 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:42.080966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9350-dadf-495f-b3a3-9878ecfede02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:42.100118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-acfe9350-dadf-495f-b3a3-9878ecfede02 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:42.101465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-acfe9350-dadf-495f-b3a3-9878ecfede02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:42.109626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 692/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:42.155049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60ca6f-1103-41c5-9e3f-d584b21db15a None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:42.170046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60ca6f-1103-41c5-9e3f-d584b21db15a None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:42.175792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebded89e-3b84-4c42-9ddd-c7db2b214659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:42.177159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded89e-3b84-4c42-9ddd-c7db2b214659 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:42.177274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded89e-3b84-4c42-9ddd-c7db2b214659 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:42.177539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded89e-3b84-4c42-9ddd-c7db2b214659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:42.186490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebded89e-3b84-4c42-9ddd-c7db2b214659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:42.188012 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebded89e-3b84-4c42-9ddd-c7db2b214659 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:42.192014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:42.198345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 687/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:44.621137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934277f-65ed-43c1-94b2-151b5c13ad20 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:44.622041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934277f-65ed-43c1-94b2-151b5c13ad20 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:44.622488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934277f-65ed-43c1-94b2-151b5c13ad20 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:44.623916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 693/1380] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:44.629304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7f6f5-c425-4506-b265-4fe08a8123c1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:44.629741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7f6f5-c425-4506-b265-4fe08a8123c1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:44.629920 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7f6f5-c425-4506-b265-4fe08a8123c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:44.648839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-9ae7f6f5-c425-4506-b265-4fe08a8123c1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:44.650027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9ae7f6f5-c425-4506-b265-4fe08a8123c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:44.658400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 688/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:44.702855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934277f-65ed-43c1-94b2-151b5c13ad20 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:44.718652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934277f-65ed-43c1-94b2-151b5c13ad20 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:44.725310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9be1e-b372-4aba-93b6-9b995b26e6a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:44.726706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9be1e-b372-4aba-93b6-9b995b26e6a6 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:44.726997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9be1e-b372-4aba-93b6-9b995b26e6a6 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:44.727278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9be1e-b372-4aba-93b6-9b995b26e6a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:44.737754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9be1e-b372-4aba-93b6-9b995b26e6a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:44.739607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9be1e-b372-4aba-93b6-9b995b26e6a6 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:44.751212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 694/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:47.072077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5076c-827f-4757-a10e-a02ec82ba062 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:47.072622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5076c-827f-4757-a10e-a02ec82ba062 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:47.072622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5076c-827f-4757-a10e-a02ec82ba062 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:47.075532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 689/1383] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:47.079430 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbe315-293b-4a1d-a1e2-54845e7f1c1c None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:47.079895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbe315-293b-4a1d-a1e2-54845e7f1c1c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:47.080020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbe315-293b-4a1d-a1e2-54845e7f1c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:47.097720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-74fbe315-293b-4a1d-a1e2-54845e7f1c1c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:47.098936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-74fbe315-293b-4a1d-a1e2-54845e7f1c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:47.106724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 695/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:47.149429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5076c-827f-4757-a10e-a02ec82ba062 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:47.163571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5076c-827f-4757-a10e-a02ec82ba062 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:47.169276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa59223-c5bd-418f-b63c-2a1818a1ee64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:47.170075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59223-c5bd-418f-b63c-2a1818a1ee64 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:47.170538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59223-c5bd-418f-b63c-2a1818a1ee64 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:47.170960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59223-c5bd-418f-b63c-2a1818a1ee64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:47.180080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa59223-c5bd-418f-b63c-2a1818a1ee64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:47.181833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa59223-c5bd-418f-b63c-2a1818a1ee64 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:47.191627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 690/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:49.611452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769ed34-d4fa-43b5-b0b5-4e05ee65f726 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:49.612064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769ed34-d4fa-43b5-b0b5-4e05ee65f726 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:49.612246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769ed34-d4fa-43b5-b0b5-4e05ee65f726 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:49.614064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 696/1386] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:49.619288 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57bda9-3158-4714-8a17-c627478585c9 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:49.619700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57bda9-3158-4714-8a17-c627478585c9 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:49.619904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57bda9-3158-4714-8a17-c627478585c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:49.639075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-fc57bda9-3158-4714-8a17-c627478585c9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:49.640345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fc57bda9-3158-4714-8a17-c627478585c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:49.649017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 691/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:49.696578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769ed34-d4fa-43b5-b0b5-4e05ee65f726 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:49.711102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769ed34-d4fa-43b5-b0b5-4e05ee65f726 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:49.718010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e227899-ef4d-4dfc-9b2e-73ce08374e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:49.718814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e227899-ef4d-4dfc-9b2e-73ce08374e16 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:49.719188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e227899-ef4d-4dfc-9b2e-73ce08374e16 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:49.719536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e227899-ef4d-4dfc-9b2e-73ce08374e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:49.730446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e227899-ef4d-4dfc-9b2e-73ce08374e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:49.732525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e227899-ef4d-4dfc-9b2e-73ce08374e16 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:49.744494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 697/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:52.239336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ab34f-15f8-4ff0-b491-e40a17c5c4e5 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:52.239891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ab34f-15f8-4ff0-b491-e40a17c5c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:52.239891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ab34f-15f8-4ff0-b491-e40a17c5c4e5 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:52.241485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 692/1389] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:32:52.247253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c3c6-fcea-4272-87ff-9dbb916c5c46 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:52.247659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c3c6-fcea-4272-87ff-9dbb916c5c46 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:52.247909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c3c6-fcea-4272-87ff-9dbb916c5c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:52.267930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4169c3c6-fcea-4272-87ff-9dbb916c5c46 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:52.269128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4169c3c6-fcea-4272-87ff-9dbb916c5c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:52.277321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 698/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:52.323190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ab34f-15f8-4ff0-b491-e40a17c5c4e5 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:52.339322 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ab34f-15f8-4ff0-b491-e40a17c5c4e5 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:52.345354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163012f-c6bd-457a-8de0-f93582125771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:52.346084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163012f-c6bd-457a-8de0-f93582125771 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:52.346403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163012f-c6bd-457a-8de0-f93582125771 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:52.346721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163012f-c6bd-457a-8de0-f93582125771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:52.356322 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163012f-c6bd-457a-8de0-f93582125771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:52.358107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163012f-c6bd-457a-8de0-f93582125771 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:52.369596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 693/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:32:54.650317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d1af1-5a53-4137-99d0-505aeac4b54c None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:54.650894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d1af1-5a53-4137-99d0-505aeac4b54c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:54.650894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d1af1-5a53-4137-99d0-505aeac4b54c None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:54.652313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 699/1392] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:54.657660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2853ac-f9b5-4341-9c1f-affabf633ff6 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:54.658087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2853ac-f9b5-4341-9c1f-affabf633ff6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:54.658198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2853ac-f9b5-4341-9c1f-affabf633ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:54.675494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ab2853ac-f9b5-4341-9c1f-affabf633ff6 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:54.677261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ab2853ac-f9b5-4341-9c1f-affabf633ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:54.684905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 694/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:54.728378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d1af1-5a53-4137-99d0-505aeac4b54c None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:54.743045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d1af1-5a53-4137-99d0-505aeac4b54c None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:54.748515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1961e0-641b-45c5-a0d8-934504bb05e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:54.749140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1961e0-641b-45c5-a0d8-934504bb05e5 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:54.749423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1961e0-641b-45c5-a0d8-934504bb05e5 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:54.749700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1961e0-641b-45c5-a0d8-934504bb05e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:54.758250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1961e0-641b-45c5-a0d8-934504bb05e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:54.759853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1961e0-641b-45c5-a0d8-934504bb05e5 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:54.769279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 700/1394] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:32:55.940070 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448c186-f2a5-4124-a33f-088ba7a837ba None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:55.940609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448c186-f2a5-4124-a33f-088ba7a837ba None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:55.940609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448c186-f2a5-4124-a33f-088ba7a837ba None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:55.942538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 695/1395] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:55.947678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b700d9-5f56-455b-84db-0317e3c538f9 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:55.948117 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b700d9-5f56-455b-84db-0317e3c538f9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:55.948268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b700d9-5f56-455b-84db-0317e3c538f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:55.966211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-e4b700d9-5f56-455b-84db-0317e3c538f9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:55.971115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e4b700d9-5f56-455b-84db-0317e3c538f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:55.975627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 701/1396] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:56.030742 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d2f8f-975d-44d3-b6c7-032192dcdbdc None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:56.031030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d2f8f-975d-44d3-b6c7-032192dcdbdc None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:56.031306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d2f8f-975d-44d3-b6c7-032192dcdbdc None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:56.032718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 696/1397] 10.222.0.27 () {54 vars in 962 bytes} [Thu Jun 16 00:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:56.037818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7b5d0-e69d-4d82-ac74-e3f8cd4468fc None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:56.038190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7b5d0-e69d-4d82-ac74-e3f8cd4468fc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:56.038543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7b5d0-e69d-4d82-ac74-e3f8cd4468fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:56.090281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f5f7b5d0-e69d-4d82-ac74-e3f8cd4468fc None None] MFA Rules not processed for user `24198f20ebcd4e64a5184fb9fc6764cd`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:56.091485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f5f7b5d0-e69d-4d82-ac74-e3f8cd4468fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:56.150743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 702/1398] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Jun 16 00:32:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:56.158374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d2f8f-975d-44d3-b6c7-032192dcdbdc None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:56.169060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d2f8f-975d-44d3-b6c7-032192dcdbdc None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:56.172566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee41a8d-bff2-4750-9bca-a4b7bbf75a5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24198f20ebcd4e64a5184fb9fc6764cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:56.173196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee41a8d-bff2-4750-9bca-a4b7bbf75a5a service glance] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:56.173479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee41a8d-bff2-4750-9bca-a4b7bbf75a5a service glance] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:56.173786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee41a8d-bff2-4750-9bca-a4b7bbf75a5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:56.183187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee41a8d-bff2-4750-9bca-a4b7bbf75a5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:56.184653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee41a8d-bff2-4750-9bca-a4b7bbf75a5a service glance] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:56.194639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 697/1399] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:57.107448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6943145-cff4-40d9-b4f0-f1315738556c None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:57.108059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6943145-cff4-40d9-b4f0-f1315738556c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:57.108168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6943145-cff4-40d9-b4f0-f1315738556c None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:57.109528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 703/1400] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:57.115392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba47d0d-979b-4742-a76e-569087528695 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:57.115905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba47d0d-979b-4742-a76e-569087528695 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:57.115987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba47d0d-979b-4742-a76e-569087528695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:57.131622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aa8b6-794f-448c-8d60-0f84be51f11f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:57.132180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aa8b6-794f-448c-8d60-0f84be51f11f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:57.132725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aa8b6-794f-448c-8d60-0f84be51f11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:57.134957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-dba47d0d-979b-4742-a76e-569087528695 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:57.136531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dba47d0d-979b-4742-a76e-569087528695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:57.138656 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=93 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:57.146069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 698/1401] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:57.183600 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-020aa8b6-794f-448c-8d60-0f84be51f11f None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:57.184842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-020aa8b6-794f-448c-8d60-0f84be51f11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:57.189506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba47d0d-979b-4742-a76e-569087528695 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:57.202441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba47d0d-979b-4742-a76e-569087528695 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:57.208617 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04c24-8c42-4b3a-aa9a-6a1c34c18bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:57.209195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04c24-8c42-4b3a-aa9a-6a1c34c18bad service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:57.209479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04c24-8c42-4b3a-aa9a-6a1c34c18bad service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:57.209749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04c24-8c42-4b3a-aa9a-6a1c34c18bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:57.218282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04c24-8c42-4b3a-aa9a-6a1c34c18bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:57.220077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04c24-8c42-4b3a-aa9a-6a1c34c18bad service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:57.231071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 699/1402] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:32:57.253811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 704/1403] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:32:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:57.293843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f5af-ed52-473c-8151-4c6733965799 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:57.294135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f5af-ed52-473c-8151-4c6733965799 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:57.294414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f5af-ed52-473c-8151-4c6733965799 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:57.295816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 700/1404] 10.222.0.27 () {54 vars in 942 bytes} [Thu Jun 16 00:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:57.302372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50fdca-f6b0-4e77-b3fc-08601f5a457d None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:57.302661 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50fdca-f6b0-4e77-b3fc-08601f5a457d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:57.302942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50fdca-f6b0-4e77-b3fc-08601f5a457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:57.351688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0c50fdca-f6b0-4e77-b3fc-08601f5a457d None None] MFA Rules not processed for user `e7ccca2836bc4004bcf39a3070b6c54f`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:57.352917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0c50fdca-f6b0-4e77-b3fc-08601f5a457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:57.422742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 705/1405] 10.222.0.27 () {58 vars in 1039 bytes} [Thu Jun 16 00:32:57 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:57.457615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703f5af-ed52-473c-8151-4c6733965799 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:57.457615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703f5af-ed52-473c-8151-4c6733965799 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:57.457615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb444b0c-4d0f-4898-9acd-942f7a99bef9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:57.457615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb444b0c-4d0f-4898-9acd-942f7a99bef9 service swift] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:57.457994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb444b0c-4d0f-4898-9acd-942f7a99bef9 service swift] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:57.457994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb444b0c-4d0f-4898-9acd-942f7a99bef9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:57.498618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb444b0c-4d0f-4898-9acd-942f7a99bef9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:57.498618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb444b0c-4d0f-4898-9acd-942f7a99bef9 service swift] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:57.498618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 701/1406] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:32:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:59.625140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a7d3-d948-4e8e-9a42-d9e439c35aaf None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:59.625761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a7d3-d948-4e8e-9a42-d9e439c35aaf None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:59.625761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a7d3-d948-4e8e-9a42-d9e439c35aaf None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:59.627262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 706/1407] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:32:59.632756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc888c-e446-49c5-bddd-3724a99e224a None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:59.633204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc888c-e446-49c5-bddd-3724a99e224a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:59.633646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc888c-e446-49c5-bddd-3724a99e224a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:59.652277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c3dc888c-e446-49c5-bddd-3724a99e224a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:59.653579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c3dc888c-e446-49c5-bddd-3724a99e224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:59.664579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 702/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:59.709192 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a7d3-d948-4e8e-9a42-d9e439c35aaf None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:59.730858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a7d3-d948-4e8e-9a42-d9e439c35aaf None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:59.736959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4a266-511f-497d-af4a-551e9dd680b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:59.737610 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4a266-511f-497d-af4a-551e9dd680b7 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:59.737894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4a266-511f-497d-af4a-551e9dd680b7 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:59.738381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4a266-511f-497d-af4a-551e9dd680b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:59.747172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4a266-511f-497d-af4a-551e9dd680b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:59.748794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4a266-511f-497d-af4a-551e9dd680b7 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:59.759091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 707/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:09.646869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=46 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:09.754449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:22.595405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c8dbe-148d-4bea-a907-f27c2a39b73b None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:22.596099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c8dbe-148d-4bea-a907-f27c2a39b73b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:22.596099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c8dbe-148d-4bea-a907-f27c2a39b73b None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:22.597437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 703/1410] 10.222.0.27 () {54 vars in 918 bytes} [Thu Jun 16 00:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:22.602654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b784a-0c0c-46dd-9eab-0edf8bec0cdc None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:22.603155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b784a-0c0c-46dd-9eab-0edf8bec0cdc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:22.603259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b784a-0c0c-46dd-9eab-0edf8bec0cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:22.620938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-133b784a-0c0c-46dd-9eab-0edf8bec0cdc None None] MFA Rules not processed for user `b2e57a7647d143f5835225616138827e`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:22.622128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-133b784a-0c0c-46dd-9eab-0edf8bec0cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:22.631237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 708/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jun 16 00:33:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:22.646161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ab3e-33f5-4cab-81ef-a15e8b7b4172 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:22.646448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ab3e-33f5-4cab-81ef-a15e8b7b4172 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:22.646725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ab3e-33f5-4cab-81ef-a15e8b7b4172 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:22.648100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 704/1412] 10.222.0.27 () {54 vars in 918 bytes} [Thu Jun 16 00:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:22.652667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5045da5-26c1-45ab-9ce7-bd662c8b033f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:22.652959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5045da5-26c1-45ab-9ce7-bd662c8b033f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:22.653238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5045da5-26c1-45ab-9ce7-bd662c8b033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:22.670277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c5045da5-26c1-45ab-9ce7-bd662c8b033f None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:22.671428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c5045da5-26c1-45ab-9ce7-bd662c8b033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:22.680716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 709/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jun 16 00:33:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:25.307981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22b7b-d1e3-4639-b5d5-ab51fc82f6bd None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:25.308509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22b7b-d1e3-4639-b5d5-ab51fc82f6bd None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:25.308509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22b7b-d1e3-4639-b5d5-ab51fc82f6bd None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:25.309813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:25.315018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edc23c-3d6e-460e-85d5-f5ace5b6baa3 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:25.315408 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edc23c-3d6e-460e-85d5-f5ace5b6baa3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:25.315578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edc23c-3d6e-460e-85d5-f5ace5b6baa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:25.333469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-25edc23c-3d6e-460e-85d5-f5ace5b6baa3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:25.334662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-25edc23c-3d6e-460e-85d5-f5ace5b6baa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:25.342457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:25.385327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c22b7b-d1e3-4639-b5d5-ab51fc82f6bd None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:25.399988 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c22b7b-d1e3-4639-b5d5-ab51fc82f6bd None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:25.405410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f5d88-1338-46aa-ad59-5071b92dc65f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:25.405916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f5d88-1338-46aa-ad59-5071b92dc65f service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:25.406198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f5d88-1338-46aa-ad59-5071b92dc65f service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:25.406471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f5d88-1338-46aa-ad59-5071b92dc65f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:25.414981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f5d88-1338-46aa-ad59-5071b92dc65f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:25.416588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f5d88-1338-46aa-ad59-5071b92dc65f service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:25.425795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 706/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:26.376112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c299b-691f-4e16-b20f-137a4029058c None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:26.376677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c299b-691f-4e16-b20f-137a4029058c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:26.376677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c299b-691f-4e16-b20f-137a4029058c None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:26.378598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:26.383392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00382f-8c59-40d0-bab1-652804ebd383 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:26.383861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00382f-8c59-40d0-bab1-652804ebd383 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:26.383999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00382f-8c59-40d0-bab1-652804ebd383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:26.402694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ce00382f-8c59-40d0-bab1-652804ebd383 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:26.403913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ce00382f-8c59-40d0-bab1-652804ebd383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:26.411773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:26.572387 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c299b-691f-4e16-b20f-137a4029058c None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:26.586834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c299b-691f-4e16-b20f-137a4029058c None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:26.592550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5acb-18bc-4515-bb75-6b1945b10918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:26.593215 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5acb-18bc-4515-bb75-6b1945b10918 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:26.593495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5acb-18bc-4515-bb75-6b1945b10918 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:26.593767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5acb-18bc-4515-bb75-6b1945b10918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:26.601805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c5acb-18bc-4515-bb75-6b1945b10918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:26.603375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c5acb-18bc-4515-bb75-6b1945b10918 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:26.612523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 712/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:27.532826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c1609-cc57-4c3f-a7e9-70916c692b6c None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:27.533391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c1609-cc57-4c3f-a7e9-70916c692b6c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:27.533391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c1609-cc57-4c3f-a7e9-70916c692b6c None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:27.535515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:27.540418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61915af3-18c5-49f5-889d-b5baf3cf9120 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:27.540812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61915af3-18c5-49f5-889d-b5baf3cf9120 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:27.540983 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61915af3-18c5-49f5-889d-b5baf3cf9120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:27.558514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-61915af3-18c5-49f5-889d-b5baf3cf9120 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:27.559698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-61915af3-18c5-49f5-889d-b5baf3cf9120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:27.567490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:27.718617 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c1609-cc57-4c3f-a7e9-70916c692b6c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:27.733079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c1609-cc57-4c3f-a7e9-70916c692b6c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:27.738601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a2333-f9bd-4fe7-a974-f52d9c3123b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:27.739144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2333-f9bd-4fe7-a974-f52d9c3123b1 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:27.739427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2333-f9bd-4fe7-a974-f52d9c3123b1 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:27.739703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2333-f9bd-4fe7-a974-f52d9c3123b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:27.747755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a2333-f9bd-4fe7-a974-f52d9c3123b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:27.749335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a2333-f9bd-4fe7-a974-f52d9c3123b1 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:27.758539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 709/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:28.654784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63227327-df81-4706-bd0e-02ef9d0b9b6d None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:28.655357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63227327-df81-4706-bd0e-02ef9d0b9b6d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:28.655357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63227327-df81-4706-bd0e-02ef9d0b9b6d None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:28.656787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:28.661723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caf3bc-d0db-49f6-8370-51b1951a7b83 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:28.662106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caf3bc-d0db-49f6-8370-51b1951a7b83 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:28.662289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caf3bc-d0db-49f6-8370-51b1951a7b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:28.679712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-80caf3bc-d0db-49f6-8370-51b1951a7b83 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:28.680937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-80caf3bc-d0db-49f6-8370-51b1951a7b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:28.688639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:28.841112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63227327-df81-4706-bd0e-02ef9d0b9b6d None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:28.855438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63227327-df81-4706-bd0e-02ef9d0b9b6d None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:28.860867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25230e-51bd-4c95-99d4-2ce29c52cc54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:28.861498 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25230e-51bd-4c95-99d4-2ce29c52cc54 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:28.861785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25230e-51bd-4c95-99d4-2ce29c52cc54 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:28.862069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25230e-51bd-4c95-99d4-2ce29c52cc54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:28.870078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25230e-51bd-4c95-99d4-2ce29c52cc54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:28.871671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25230e-51bd-4c95-99d4-2ce29c52cc54 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:28.883185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 715/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:29.792516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a81c0-aa22-4c79-89db-ddc9a49fa9b7 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:29.792987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a81c0-aa22-4c79-89db-ddc9a49fa9b7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:29.793108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a81c0-aa22-4c79-89db-ddc9a49fa9b7 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:29.794470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:29.799820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627502-f6a1-459d-a2b6-a13e4d84dcfb None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:29.800206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627502-f6a1-459d-a2b6-a13e4d84dcfb None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:29.800375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627502-f6a1-459d-a2b6-a13e4d84dcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:29.819706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f3627502-f6a1-459d-a2b6-a13e4d84dcfb None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:29.820942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f3627502-f6a1-459d-a2b6-a13e4d84dcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:29.828861 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:29.980952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a81c0-aa22-4c79-89db-ddc9a49fa9b7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:29.995814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a81c0-aa22-4c79-89db-ddc9a49fa9b7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:30.001073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8759de-fe99-449d-b700-6e113e3974db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:30.001711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8759de-fe99-449d-b700-6e113e3974db service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:30.001997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8759de-fe99-449d-b700-6e113e3974db service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:30.002837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8759de-fe99-449d-b700-6e113e3974db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:30.011047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8759de-fe99-449d-b700-6e113e3974db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:30.012668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8759de-fe99-449d-b700-6e113e3974db service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:30.022394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 712/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:30.934360 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967ca42-6d3e-4d81-8c03-3b589bee3c1f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:30.934884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967ca42-6d3e-4d81-8c03-3b589bee3c1f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:30.934884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967ca42-6d3e-4d81-8c03-3b589bee3c1f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:30.936268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:30.941716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff77ad-6b53-4c0f-94d3-a32239618622 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:30.942227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff77ad-6b53-4c0f-94d3-a32239618622 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:30.942335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff77ad-6b53-4c0f-94d3-a32239618622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:30.960257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-f9ff77ad-6b53-4c0f-94d3-a32239618622 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:30.961430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f9ff77ad-6b53-4c0f-94d3-a32239618622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:30.969048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:31.120136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967ca42-6d3e-4d81-8c03-3b589bee3c1f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:31.139921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967ca42-6d3e-4d81-8c03-3b589bee3c1f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:31.145916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db9e6-54c0-4d6a-bbdb-9074ecf5d525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:31.146546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db9e6-54c0-4d6a-bbdb-9074ecf5d525 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:31.146827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db9e6-54c0-4d6a-bbdb-9074ecf5d525 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:31.147099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db9e6-54c0-4d6a-bbdb-9074ecf5d525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:31.155039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158db9e6-54c0-4d6a-bbdb-9074ecf5d525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:31.156638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158db9e6-54c0-4d6a-bbdb-9074ecf5d525 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:31.165820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 718/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:32.070945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bbda9-5d26-4aa8-b1bb-a0fbd0939163 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:32.071381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bbda9-5d26-4aa8-b1bb-a0fbd0939163 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:32.071530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bbda9-5d26-4aa8-b1bb-a0fbd0939163 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:32.072932 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:32.077870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245475d-ae6d-4545-a641-7583567cd800 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:32.078305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245475d-ae6d-4545-a641-7583567cd800 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:32.078541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245475d-ae6d-4545-a641-7583567cd800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:32.097247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-2245475d-ae6d-4545-a641-7583567cd800 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:32.099695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-2245475d-ae6d-4545-a641-7583567cd800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:32.106408 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:32.260999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bbda9-5d26-4aa8-b1bb-a0fbd0939163 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:32.275624 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bbda9-5d26-4aa8-b1bb-a0fbd0939163 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:32.280931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656f27-8714-444a-b6ae-ff027883e198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:32.281559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656f27-8714-444a-b6ae-ff027883e198 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:32.281841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656f27-8714-444a-b6ae-ff027883e198 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:32.282120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656f27-8714-444a-b6ae-ff027883e198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:32.290701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab656f27-8714-444a-b6ae-ff027883e198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:32.292388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab656f27-8714-444a-b6ae-ff027883e198 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:32.301603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 715/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:33.206831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3ec1-2037-4497-98b0-37ed9a231edd None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:33.207395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3ec1-2037-4497-98b0-37ed9a231edd None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:33.207395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3ec1-2037-4497-98b0-37ed9a231edd None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:33.208811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:33.213690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6727aff-6d40-4aa5-968f-74861d0c0f62 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:33.214098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6727aff-6d40-4aa5-968f-74861d0c0f62 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:33.214284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6727aff-6d40-4aa5-968f-74861d0c0f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:33.232653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-f6727aff-6d40-4aa5-968f-74861d0c0f62 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:33.233858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f6727aff-6d40-4aa5-968f-74861d0c0f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:33.242523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:33:33.392166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3ec1-2037-4497-98b0-37ed9a231edd None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:33.406518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3ec1-2037-4497-98b0-37ed9a231edd None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:33.412346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e53bd-7b21-4860-925a-4acd91121d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:33.412972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e53bd-7b21-4860-925a-4acd91121d17 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:33.413250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e53bd-7b21-4860-925a-4acd91121d17 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:33.413524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e53bd-7b21-4860-925a-4acd91121d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:33.421635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e53bd-7b21-4860-925a-4acd91121d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:33.423268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e53bd-7b21-4860-925a-4acd91121d17 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:33.433289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 721/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:34.332813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51899b3f-9dd0-4893-a2ab-37041b466337 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:34.333401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51899b3f-9dd0-4893-a2ab-37041b466337 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:34.333401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51899b3f-9dd0-4893-a2ab-37041b466337 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:34.334750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:34.339554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c458fb-05b5-47a9-bdf3-a6bfd655f330 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:34.339995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c458fb-05b5-47a9-bdf3-a6bfd655f330 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:34.340149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c458fb-05b5-47a9-bdf3-a6bfd655f330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:34.357666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d1c458fb-05b5-47a9-bdf3-a6bfd655f330 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:34.358857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d1c458fb-05b5-47a9-bdf3-a6bfd655f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:34.367137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:34.516101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51899b3f-9dd0-4893-a2ab-37041b466337 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:34.530827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51899b3f-9dd0-4893-a2ab-37041b466337 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:34.536817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572c78a-f65d-4234-b0b6-a4e42646fb71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:34.537446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572c78a-f65d-4234-b0b6-a4e42646fb71 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:34.537733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572c78a-f65d-4234-b0b6-a4e42646fb71 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:34.538008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572c78a-f65d-4234-b0b6-a4e42646fb71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:34.546249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572c78a-f65d-4234-b0b6-a4e42646fb71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:34.547886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572c78a-f65d-4234-b0b6-a4e42646fb71 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:34.557417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 718/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:36.582874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bba21-1783-4472-8000-a0be3076e40f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:36.583417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bba21-1783-4472-8000-a0be3076e40f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:36.583417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bba21-1783-4472-8000-a0be3076e40f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:36.584892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:36.590221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0721-80e9-492f-8dfc-9f0a36582c64 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:36.590650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0721-80e9-492f-8dfc-9f0a36582c64 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:36.590763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0721-80e9-492f-8dfc-9f0a36582c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:36.609405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4e7e0721-80e9-492f-8dfc-9f0a36582c64 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:36.610578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4e7e0721-80e9-492f-8dfc-9f0a36582c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:36.618240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:36.656461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bba21-1783-4472-8000-a0be3076e40f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:36.667725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bba21-1783-4472-8000-a0be3076e40f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:36.671278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7113f43-5483-4f01-a262-82d6b21d2fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:36.671949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7113f43-5483-4f01-a262-82d6b21d2fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:36.672234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7113f43-5483-4f01-a262-82d6b21d2fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:36.672514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7113f43-5483-4f01-a262-82d6b21d2fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:36.681585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7113f43-5483-4f01-a262-82d6b21d2fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:36.682997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7113f43-5483-4f01-a262-82d6b21d2fc5 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:36.692125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 724/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:38.998209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4913-b655-4e61-97d9-397584ac1c32 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:38.998782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4913-b655-4e61-97d9-397584ac1c32 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:38.998782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4913-b655-4e61-97d9-397584ac1c32 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:39.000140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:39.005907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19846be2-45e7-4523-856a-31ed4a71bd0b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:39.006344 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19846be2-45e7-4523-856a-31ed4a71bd0b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:39.006446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19846be2-45e7-4523-856a-31ed4a71bd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:39.023847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-19846be2-45e7-4523-856a-31ed4a71bd0b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:39.025039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-19846be2-45e7-4523-856a-31ed4a71bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:39.032790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:39.071116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4913-b655-4e61-97d9-397584ac1c32 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:39.081689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4913-b655-4e61-97d9-397584ac1c32 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:39.085154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3af77d-3c6a-466c-8bcf-3ac7806bd134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:39.085778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3af77d-3c6a-466c-8bcf-3ac7806bd134 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:39.086061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3af77d-3c6a-466c-8bcf-3ac7806bd134 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:39.086336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3af77d-3c6a-466c-8bcf-3ac7806bd134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:39.095000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3af77d-3c6a-466c-8bcf-3ac7806bd134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:39.097135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3af77d-3c6a-466c-8bcf-3ac7806bd134 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:39.106367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 721/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:41.597504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ce0a8-1007-41f8-9fc0-94e2c7952de0 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:41.598075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ce0a8-1007-41f8-9fc0-94e2c7952de0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:41.598075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ce0a8-1007-41f8-9fc0-94e2c7952de0 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:41.599435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:41.604703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a51a6-0dcb-4e8c-b722-79c1df50b881 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:41.605153 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a51a6-0dcb-4e8c-b722-79c1df50b881 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:41.605274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a51a6-0dcb-4e8c-b722-79c1df50b881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:41.623147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-de2a51a6-0dcb-4e8c-b722-79c1df50b881 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:41.624521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-de2a51a6-0dcb-4e8c-b722-79c1df50b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:41.633191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:41.671615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ce0a8-1007-41f8-9fc0-94e2c7952de0 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:41.682836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ce0a8-1007-41f8-9fc0-94e2c7952de0 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:41.686666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42395dc7-29bb-4112-a068-8cdd9c74c905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:41.687331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395dc7-29bb-4112-a068-8cdd9c74c905 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:41.687633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395dc7-29bb-4112-a068-8cdd9c74c905 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:41.687946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395dc7-29bb-4112-a068-8cdd9c74c905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:41.698023 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42395dc7-29bb-4112-a068-8cdd9c74c905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:41.699520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42395dc7-29bb-4112-a068-8cdd9c74c905 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:41.710451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 727/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:43.943933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db89dce-40c0-4993-9c00-0631e23dd9b1 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:43.944551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db89dce-40c0-4993-9c00-0631e23dd9b1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:43.944551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db89dce-40c0-4993-9c00-0631e23dd9b1 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:43.945854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:43.950930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8c33-4e1e-4043-b4c8-beee4562b6b3 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:43.951324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8c33-4e1e-4043-b4c8-beee4562b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:43.951499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8c33-4e1e-4043-b4c8-beee4562b6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:43.969236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-508c8c33-4e1e-4043-b4c8-beee4562b6b3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:43.970970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-508c8c33-4e1e-4043-b4c8-beee4562b6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:43.978586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:44.016280 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db89dce-40c0-4993-9c00-0631e23dd9b1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:44.027694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db89dce-40c0-4993-9c00-0631e23dd9b1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:44.031253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72d759-8aeb-458b-9e19-b3b7d40467be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:44.031920 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72d759-8aeb-458b-9e19-b3b7d40467be service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:44.032204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72d759-8aeb-458b-9e19-b3b7d40467be service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:44.032483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72d759-8aeb-458b-9e19-b3b7d40467be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:44.042279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72d759-8aeb-458b-9e19-b3b7d40467be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:44.043725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72d759-8aeb-458b-9e19-b3b7d40467be service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:44.053157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 724/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:46.212302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ecb1d-9597-4eab-8e0e-61d12285cc3f None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:46.212883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ecb1d-9597-4eab-8e0e-61d12285cc3f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:46.212883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ecb1d-9597-4eab-8e0e-61d12285cc3f None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:46.214249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:46.219364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7aa96-7f20-49be-b209-47446fa37e06 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:46.219823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7aa96-7f20-49be-b209-47446fa37e06 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:46.219940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7aa96-7f20-49be-b209-47446fa37e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:46.238541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-84a7aa96-7f20-49be-b209-47446fa37e06 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:46.239723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-84a7aa96-7f20-49be-b209-47446fa37e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:46.247397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:46.287341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ecb1d-9597-4eab-8e0e-61d12285cc3f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:46.289169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-bf0ecb1d-9597-4eab-8e0e-61d12285cc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:46.301855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ecb1d-9597-4eab-8e0e-61d12285cc3f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:46.305597 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bda9c9-7552-4829-be79-05f8991ad85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:46.306245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bda9c9-7552-4829-be79-05f8991ad85a service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:46.306530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bda9c9-7552-4829-be79-05f8991ad85a service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:46.306810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bda9c9-7552-4829-be79-05f8991ad85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:46.315813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bda9c9-7552-4829-be79-05f8991ad85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:46.317231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bda9c9-7552-4829-be79-05f8991ad85a service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:46.326370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 730/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:48.462498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47546d4-df0d-480e-925a-68374677459a None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:48.463058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47546d4-df0d-480e-925a-68374677459a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:48.463058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47546d4-df0d-480e-925a-68374677459a None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:48.464426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:48.469611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66734f4-dd85-4d0d-ba86-0ec23ea772c3 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:48.470053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66734f4-dd85-4d0d-ba86-0ec23ea772c3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:48.470190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66734f4-dd85-4d0d-ba86-0ec23ea772c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:48.488127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c66734f4-dd85-4d0d-ba86-0ec23ea772c3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:48.489321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c66734f4-dd85-4d0d-ba86-0ec23ea772c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:48.497095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:33:48.535493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47546d4-df0d-480e-925a-68374677459a None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:48.545908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47546d4-df0d-480e-925a-68374677459a None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:48.549836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee545c54-5dcb-4480-9045-63e22a60bacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:48.550456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee545c54-5dcb-4480-9045-63e22a60bacf service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:48.550736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee545c54-5dcb-4480-9045-63e22a60bacf service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:48.551008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee545c54-5dcb-4480-9045-63e22a60bacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:48.559595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee545c54-5dcb-4480-9045-63e22a60bacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:48.561054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee545c54-5dcb-4480-9045-63e22a60bacf service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:48.570741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 727/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:50.766908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da426e55-0044-4a2b-8be0-a483a6cb4471 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:50.767447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da426e55-0044-4a2b-8be0-a483a6cb4471 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:50.767447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da426e55-0044-4a2b-8be0-a483a6cb4471 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:50.768906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:50.774308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b17bc-3d41-48c1-8c7e-02e01dee5646 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:50.774722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b17bc-3d41-48c1-8c7e-02e01dee5646 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:50.774897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b17bc-3d41-48c1-8c7e-02e01dee5646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:50.781494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=70 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:50.793234 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-fb9b17bc-3d41-48c1-8c7e-02e01dee5646 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:50.794437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fb9b17bc-3d41-48c1-8c7e-02e01dee5646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:50.803378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:50.840666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da426e55-0044-4a2b-8be0-a483a6cb4471 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:50.845997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=73 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:50.851621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da426e55-0044-4a2b-8be0-a483a6cb4471 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:50.855228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e286c-12f3-4392-96ce-24916fb0c41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:50.855954 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e286c-12f3-4392-96ce-24916fb0c41d service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:50.856235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e286c-12f3-4392-96ce-24916fb0c41d service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:50.856546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e286c-12f3-4392-96ce-24916fb0c41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:50.866476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e286c-12f3-4392-96ce-24916fb0c41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:50.867927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e286c-12f3-4392-96ce-24916fb0c41d service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:50.877626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 733/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:53.031986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36db01-3e7e-4d98-92fb-45ca094e4ec2 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:53.032600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36db01-3e7e-4d98-92fb-45ca094e4ec2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:53.032600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36db01-3e7e-4d98-92fb-45ca094e4ec2 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:53.034502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:53.039753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8703-0122-47a0-b4a8-b3b00e2e5d34 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:53.040166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8703-0122-47a0-b4a8-b3b00e2e5d34 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:53.040484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd8703-0122-47a0-b4a8-b3b00e2e5d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:53.058017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-a4fd8703-0122-47a0-b4a8-b3b00e2e5d34 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:53.059218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a4fd8703-0122-47a0-b4a8-b3b00e2e5d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:53.067059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:53.104600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36db01-3e7e-4d98-92fb-45ca094e4ec2 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:53.115279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36db01-3e7e-4d98-92fb-45ca094e4ec2 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:53.118683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2467670-b884-4e1d-97e6-f37221e337aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:53.119302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467670-b884-4e1d-97e6-f37221e337aa service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:53.119581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467670-b884-4e1d-97e6-f37221e337aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:53.119899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467670-b884-4e1d-97e6-f37221e337aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:53.128700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2467670-b884-4e1d-97e6-f37221e337aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:53.130128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2467670-b884-4e1d-97e6-f37221e337aa service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:53.139597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 730/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:33:55.326626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde1b98-f072-4dfe-8791-b7f4ac9c2777 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:55.327161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde1b98-f072-4dfe-8791-b7f4ac9c2777 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:55.327272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde1b98-f072-4dfe-8791-b7f4ac9c2777 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:55.328609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:55.333820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082214-7537-466a-8814-e54bc1ba9aef None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:55.334212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082214-7537-466a-8814-e54bc1ba9aef None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:55.334385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34082214-7537-466a-8814-e54bc1ba9aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:55.351755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-34082214-7537-466a-8814-e54bc1ba9aef None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:55.353005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-34082214-7537-466a-8814-e54bc1ba9aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:55.361546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:55.398336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde1b98-f072-4dfe-8791-b7f4ac9c2777 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:55.409029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde1b98-f072-4dfe-8791-b7f4ac9c2777 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:55.412517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3aec4-4b74-46f5-a811-ce5b583bddd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:55.413145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3aec4-4b74-46f5-a811-ce5b583bddd3 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:55.413428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3aec4-4b74-46f5-a811-ce5b583bddd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:55.413703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3aec4-4b74-46f5-a811-ce5b583bddd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:55.422421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3aec4-4b74-46f5-a811-ce5b583bddd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:55.424422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3aec4-4b74-46f5-a811-ce5b583bddd3 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:55.433677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 736/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:57.572912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3276-03fd-4e28-bd24-94ff619d5492 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:57.573485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3276-03fd-4e28-bd24-94ff619d5492 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:57.573485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3276-03fd-4e28-bd24-94ff619d5492 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:57.574843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:33:57.580096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e435c7-362a-458f-ba35-3883ae1d7a80 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:57.580488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e435c7-362a-458f-ba35-3883ae1d7a80 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:57.580665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e435c7-362a-458f-ba35-3883ae1d7a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:57.598132 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d3e435c7-362a-458f-ba35-3883ae1d7a80 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:57.599321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d3e435c7-362a-458f-ba35-3883ae1d7a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:57.607109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:57.644383 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba3276-03fd-4e28-bd24-94ff619d5492 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:57.654937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba3276-03fd-4e28-bd24-94ff619d5492 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:57.658408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5f562-b704-4590-ace5-1822a305a53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:57.659032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5f562-b704-4590-ace5-1822a305a53b service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:57.659316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5f562-b704-4590-ace5-1822a305a53b service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:57.659594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5f562-b704-4590-ace5-1822a305a53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:57.668272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5f562-b704-4590-ace5-1822a305a53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:57.669700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5f562-b704-4590-ace5-1822a305a53b service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:57.679381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 733/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:07.593026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=17 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:07.675269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=17 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:18.411288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ae1e-dce6-42d1-8f41-b3da0d96c72c None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:18.411952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ae1e-dce6-42d1-8f41-b3da0d96c72c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:18.411952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ae1e-dce6-42d1-8f41-b3da0d96c72c None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:18.413280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 738/1471] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:34:18.418416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390d319-5058-4a4c-9134-79b79fa8a89b None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:18.418823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390d319-5058-4a4c-9134-79b79fa8a89b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:18.418974 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390d319-5058-4a4c-9134-79b79fa8a89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:18.436969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-9390d319-5058-4a4c-9134-79b79fa8a89b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:18.438212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9390d319-5058-4a4c-9134-79b79fa8a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:18.445891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 734/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:18.492886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ae09a-b609-47a8-9960-94854d0e929b None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:18.495945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ae09a-b609-47a8-9960-94854d0e929b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:18.495945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ae09a-b609-47a8-9960-94854d0e929b None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:18.495945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 739/1473] 10.222.0.27 () {54 vars in 962 bytes} [Thu Jun 16 00:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:34:18.499530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe38ca-51c1-49c1-8363-5ab1ec456db2 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:18.499851 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe38ca-51c1-49c1-8363-5ab1ec456db2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:18.500161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe38ca-51c1-49c1-8363-5ab1ec456db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:18.518600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-8ebe38ca-51c1-49c1-8363-5ab1ec456db2 None None] MFA Rules not processed for user `24198f20ebcd4e64a5184fb9fc6764cd`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:18.519803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8ebe38ca-51c1-49c1-8363-5ab1ec456db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:18.526713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 735/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Jun 16 00:34:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:18.534502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ae09a-b609-47a8-9960-94854d0e929b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:18.544947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ae09a-b609-47a8-9960-94854d0e929b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:18.548449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375492b7-65d7-44a1-bffe-841ea34e828b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24198f20ebcd4e64a5184fb9fc6764cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:18.549061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375492b7-65d7-44a1-bffe-841ea34e828b service glance] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:18.549350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375492b7-65d7-44a1-bffe-841ea34e828b service glance] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:18.549621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375492b7-65d7-44a1-bffe-841ea34e828b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:18.558306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375492b7-65d7-44a1-bffe-841ea34e828b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:18.559709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375492b7-65d7-44a1-bffe-841ea34e828b service glance] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:18.568777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 740/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:34:20.751789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4bdb5-a02c-42ee-a093-23d28350b65b None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:20.752365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4bdb5-a02c-42ee-a093-23d28350b65b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:20.752365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4bdb5-a02c-42ee-a093-23d28350b65b None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:20.753707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 736/1476] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:34:20.758785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176d4e-9e2c-4b55-b1b2-ab3409b768a0 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:20.759222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176d4e-9e2c-4b55-b1b2-ab3409b768a0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:20.759346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176d4e-9e2c-4b55-b1b2-ab3409b768a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:20.777634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7f176d4e-9e2c-4b55-b1b2-ab3409b768a0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:20.778828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7f176d4e-9e2c-4b55-b1b2-ab3409b768a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:20.787172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 741/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:20.809870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4bdb5-a02c-42ee-a093-23d28350b65b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:20.821926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4bdb5-a02c-42ee-a093-23d28350b65b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:20.826250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff446e-32a1-4504-abcd-df3cf03286c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:20.826884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff446e-32a1-4504-abcd-df3cf03286c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:20.827163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff446e-32a1-4504-abcd-df3cf03286c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:20.827440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff446e-32a1-4504-abcd-df3cf03286c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:20.828738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff446e-32a1-4504-abcd-df3cf03286c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:20.830497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WARNING py.warnings [None req-1eff446e-32a1-4504-abcd-df3cf03286c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:34:20.830497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: warnings.warn(msg) Jun 16 00:34:20.830497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: Jun 16 00:34:20.831637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff446e-32a1-4504-abcd-df3cf03286c0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:20.850884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 737/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 16 00:34:20 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:34:23.056415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ca3b-bb29-42fd-8eb3-5d65eb4cf45e None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:23.056927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ca3b-bb29-42fd-8eb3-5d65eb4cf45e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:23.057043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ca3b-bb29-42fd-8eb3-5d65eb4cf45e None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:23.058339 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 742/1479] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:34:23.063848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5140-f8d0-4cf9-9040-41b0046c5660 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:23.064259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5140-f8d0-4cf9-9040-41b0046c5660 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:23.064415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5140-f8d0-4cf9-9040-41b0046c5660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:23.082471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-02cf5140-f8d0-4cf9-9040-41b0046c5660 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:23.083673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-02cf5140-f8d0-4cf9-9040-41b0046c5660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:23.091327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 738/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:34:23.133626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480ca3b-bb29-42fd-8eb3-5d65eb4cf45e None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:23.148176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480ca3b-bb29-42fd-8eb3-5d65eb4cf45e None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:23.153495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630bf67-118a-45a1-a835-ed71bb614fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:23.154116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bf67-118a-45a1-a835-ed71bb614fa0 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:23.154398 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bf67-118a-45a1-a835-ed71bb614fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:23.154671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bf67-118a-45a1-a835-ed71bb614fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:23.163263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630bf67-118a-45a1-a835-ed71bb614fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:23.164868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630bf67-118a-45a1-a835-ed71bb614fa0 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:23.174056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 743/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:25.449307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c50701-52d8-4123-a107-54bee2f60364 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:25.449868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c50701-52d8-4123-a107-54bee2f60364 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:25.449868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c50701-52d8-4123-a107-54bee2f60364 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:25.451214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 739/1482] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:34:25.456827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea261d-4f9f-4d09-b928-27f8cced3704 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:25.457238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea261d-4f9f-4d09-b928-27f8cced3704 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:25.457388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea261d-4f9f-4d09-b928-27f8cced3704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:25.475053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d5ea261d-4f9f-4d09-b928-27f8cced3704 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:25.476256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d5ea261d-4f9f-4d09-b928-27f8cced3704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:25.483867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 744/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:25.531917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c50701-52d8-4123-a107-54bee2f60364 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:25.531917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c50701-52d8-4123-a107-54bee2f60364 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:25.534190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7472e-bb42-49bf-988a-7e9362795617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:25.534818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7472e-bb42-49bf-988a-7e9362795617 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:25.535102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7472e-bb42-49bf-988a-7e9362795617 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:25.535378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7472e-bb42-49bf-988a-7e9362795617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:25.544148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7472e-bb42-49bf-988a-7e9362795617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:25.545577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7472e-bb42-49bf-988a-7e9362795617 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:25.554808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 740/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:27.701096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac36f6-5cc9-40c4-975e-772506af6f19 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:27.701644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac36f6-5cc9-40c4-975e-772506af6f19 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:27.701644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac36f6-5cc9-40c4-975e-772506af6f19 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:27.703561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 745/1485] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:34:27.708687 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d52c58-cb74-4081-aba9-9f4837538195 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:27.709084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d52c58-cb74-4081-aba9-9f4837538195 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:27.709243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d52c58-cb74-4081-aba9-9f4837538195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:27.727200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-82d52c58-cb74-4081-aba9-9f4837538195 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:27.728401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-82d52c58-cb74-4081-aba9-9f4837538195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:27.736468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 741/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:27.773724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac36f6-5cc9-40c4-975e-772506af6f19 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:27.784908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac36f6-5cc9-40c4-975e-772506af6f19 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:27.788485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d47b1-76aa-45aa-8a45-826991ee2d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:27.789115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d47b1-76aa-45aa-8a45-826991ee2d61 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:27.789397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d47b1-76aa-45aa-8a45-826991ee2d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:27.789672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d47b1-76aa-45aa-8a45-826991ee2d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:27.798510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d47b1-76aa-45aa-8a45-826991ee2d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:27.799957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d47b1-76aa-45aa-8a45-826991ee2d61 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:27.809112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 746/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:30.083372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1817407-c133-461e-8293-76bc59df27b1 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:30.083964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1817407-c133-461e-8293-76bc59df27b1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:30.083964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1817407-c133-461e-8293-76bc59df27b1 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:30.085328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 742/1488] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:34:30.090518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd08259-e3fa-4b91-aa0e-6c6064e582e8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:30.090929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd08259-e3fa-4b91-aa0e-6c6064e582e8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:30.091078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd08259-e3fa-4b91-aa0e-6c6064e582e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:30.109539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7cd08259-e3fa-4b91-aa0e-6c6064e582e8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:30.110730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7cd08259-e3fa-4b91-aa0e-6c6064e582e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:30.118456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 747/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:34:30.158544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1817407-c133-461e-8293-76bc59df27b1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:30.169176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1817407-c133-461e-8293-76bc59df27b1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:30.172950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76600dbf-c3a2-45a2-9d9f-158ba215bf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:30.173578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600dbf-c3a2-45a2-9d9f-158ba215bf9f service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:30.173860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600dbf-c3a2-45a2-9d9f-158ba215bf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:30.174138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600dbf-c3a2-45a2-9d9f-158ba215bf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:30.182917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76600dbf-c3a2-45a2-9d9f-158ba215bf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:30.184383 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76600dbf-c3a2-45a2-9d9f-158ba215bf9f service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:30.194618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 743/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:33.082454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56951-3717-41e0-8ad4-7c27fba4c64c None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:33.082996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56951-3717-41e0-8ad4-7c27fba4c64c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:33.083110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56951-3717-41e0-8ad4-7c27fba4c64c None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:33.084527 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 748/1491] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 16 00:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:34:33.089847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18613757-fe04-4048-8d2b-b5fbc6ce48ae None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:33.090272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18613757-fe04-4048-8d2b-b5fbc6ce48ae None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:33.090405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18613757-fe04-4048-8d2b-b5fbc6ce48ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:33.108041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-18613757-fe04-4048-8d2b-b5fbc6ce48ae None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:33.109291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-18613757-fe04-4048-8d2b-b5fbc6ce48ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:33.117093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 744/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 16 00:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:33.157700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56951-3717-41e0-8ad4-7c27fba4c64c None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:33.168717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56951-3717-41e0-8ad4-7c27fba4c64c None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:33.172244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9bdee-c0a3-43c7-8ad5-4e2f2ec59415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:33.172875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9bdee-c0a3-43c7-8ad5-4e2f2ec59415 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:33.173162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9bdee-c0a3-43c7-8ad5-4e2f2ec59415 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:33.173442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9bdee-c0a3-43c7-8ad5-4e2f2ec59415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:33.182334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9bdee-c0a3-43c7-8ad5-4e2f2ec59415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:33.183870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9bdee-c0a3-43c7-8ad5-4e2f2ec59415 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:33.194004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 749/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:43.102931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=33 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:43.189654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=33 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:07.782817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e1bba-de85-4cca-984a-279bcaaa460d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:07.783428 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e1bba-de85-4cca-984a-279bcaaa460d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:07.783428 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e1bba-de85-4cca-984a-279bcaaa460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:07.801529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-dc5e1bba-de85-4cca-984a-279bcaaa460d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:07.802710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dc5e1bba-de85-4cca-984a-279bcaaa460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:07.810498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 745/1494] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:07.819504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c01ae-4d3f-4cae-b72f-a4d4881b06f6 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:07.820036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c01ae-4d3f-4cae-b72f-a4d4881b06f6 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:07.820144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c01ae-4d3f-4cae-b72f-a4d4881b06f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:07.837961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8c0c01ae-4d3f-4cae-b72f-a4d4881b06f6 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:07.839646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8c0c01ae-4d3f-4cae-b72f-a4d4881b06f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:07.847586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 750/1495] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:07.852324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e1bba-de85-4cca-984a-279bcaaa460d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:07.862321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e1bba-de85-4cca-984a-279bcaaa460d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:07.866970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:07.867624 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:07.867937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:07.868216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:07.868929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:36:07.869237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:07.870310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WARNING py.warnings [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:36:07.870310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: warnings.warn(msg) Jun 16 00:36:07.870310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: Jun 16 00:36:07.871218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:07.882834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 746/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:36:07.891177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c01ae-4d3f-4cae-b72f-a4d4881b06f6 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:07.900800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c01ae-4d3f-4cae-b72f-a4d4881b06f6 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:07.906049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c71a0-b136-4a7a-94bb-b6b8ca506b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:07.906705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c71a0-b136-4a7a-94bb-b6b8ca506b13 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:07.906986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c71a0-b136-4a7a-94bb-b6b8ca506b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:07.907270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c71a0-b136-4a7a-94bb-b6b8ca506b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:07.907986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c71a0-b136-4a7a-94bb-b6b8ca506b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:07.909757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WARNING py.warnings [None req-227c71a0-b136-4a7a-94bb-b6b8ca506b13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:36:07.909757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: warnings.warn(msg) Jun 16 00:36:07.909757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: Jun 16 00:36:07.910944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c71a0-b136-4a7a-94bb-b6b8ca506b13 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:08.018154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 751/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:07 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:08.022317 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:08.032708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad89596-8a10-4303-908a-b93b23a32867 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:08.088180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fa4bc-9867-4805-abc0-1e1357a924ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:08.088850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fa4bc-9867-4805-abc0-1e1357a924ec admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.089774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fa4bc-9867-4805-abc0-1e1357a924ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.090052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fa4bc-9867-4805-abc0-1e1357a924ec admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.090737 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fa4bc-9867-4805-abc0-1e1357a924ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:08.091776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WARNING py.warnings [None req-be8fa4bc-9867-4805-abc0-1e1357a924ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:36:08.091776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: warnings.warn(msg) Jun 16 00:36:08.091776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: Jun 16 00:36:08.093184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fa4bc-9867-4805-abc0-1e1357a924ec admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:08.164911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 747/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:08 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:08.169208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c71a0-b136-4a7a-94bb-b6b8ca506b13 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:08.179245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c71a0-b136-4a7a-94bb-b6b8ca506b13 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:08.183690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35a95b-83e4-4013-a220-fb5188db67ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:08.184369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35a95b-83e4-4013-a220-fb5188db67ca admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.184650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35a95b-83e4-4013-a220-fb5188db67ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.184925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35a95b-83e4-4013-a220-fb5188db67ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.185638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35a95b-83e4-4013-a220-fb5188db67ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:08.186646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WARNING py.warnings [None req-ae35a95b-83e4-4013-a220-fb5188db67ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:36:08.186646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: warnings.warn(msg) Jun 16 00:36:08.186646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: Jun 16 00:36:08.187512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35a95b-83e4-4013-a220-fb5188db67ca admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:08.200535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 752/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:08.204561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fa4bc-9867-4805-abc0-1e1357a924ec admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:08.215152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fa4bc-9867-4805-abc0-1e1357a924ec admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:08.219716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2f9cb-e37a-42aa-a615-f2ed28b690a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:08.220416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f9cb-e37a-42aa-a615-f2ed28b690a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.220702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f9cb-e37a-42aa-a615-f2ed28b690a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.221004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f9cb-e37a-42aa-a615-f2ed28b690a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.221727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2f9cb-e37a-42aa-a615-f2ed28b690a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:08.222748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WARNING py.warnings [None req-0dc2f9cb-e37a-42aa-a615-f2ed28b690a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:36:08.222748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: warnings.warn(msg) Jun 16 00:36:08.222748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: Jun 16 00:36:08.223630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2f9cb-e37a-42aa-a615-f2ed28b690a5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:08.236903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 748/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:08.240849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35a95b-83e4-4013-a220-fb5188db67ca admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:08.250438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35a95b-83e4-4013-a220-fb5188db67ca admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:08.254864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455187d-407e-4b9a-9bfc-7335e9979d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:08.255720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455187d-407e-4b9a-9bfc-7335e9979d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.256031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455187d-407e-4b9a-9bfc-7335e9979d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.256307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455187d-407e-4b9a-9bfc-7335e9979d99 admin admin] PATH_INFO: `/v3/projects/b8c216eb926e4ea4b59c044981875fe4/users/6f3f159cf2ed4404961b47a437c1328f/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.270927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455187d-407e-4b9a-9bfc-7335e9979d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c216eb926e4ea4b59c044981875fe4, user_id=6f3f159cf2ed4404961b47a437c1328f, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:08.271978 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WARNING py.warnings [None req-8455187d-407e-4b9a-9bfc-7335e9979d99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:36:08.271978 dv-cinder-803823-11-smb devstack@keystone.service[97111]: warnings.warn(msg) Jun 16 00:36:08.271978 dv-cinder-803823-11-smb devstack@keystone.service[97111]: Jun 16 00:36:08.273877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455187d-407e-4b9a-9bfc-7335e9979d99 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:08.370962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 753/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:08 2022] PUT /identity/v3/projects/b8c216eb926e4ea4b59c044981875fe4/users/6f3f159cf2ed4404961b47a437c1328f/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:08.382092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c7b20-03b6-4694-a8bb-c7fa253a57b6 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.382392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c7b20-03b6-4694-a8bb-c7fa253a57b6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.382682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c7b20-03b6-4694-a8bb-c7fa253a57b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.409268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ad9c7b20-03b6-4694-a8bb-c7fa253a57b6 None None] MFA Rules not processed for user `6f3f159cf2ed4404961b47a437c1328f`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:08.410504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ad9c7b20-03b6-4694-a8bb-c7fa253a57b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:08.473592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 749/1502] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:36:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:08.486868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56348d1a-3a42-48ed-84bf-d5d3cf4fa568 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.487156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56348d1a-3a42-48ed-84bf-d5d3cf4fa568 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.487451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56348d1a-3a42-48ed-84bf-d5d3cf4fa568 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.488844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 754/1503] 10.222.0.27 () {54 vars in 963 bytes} [Thu Jun 16 00:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:36:08.493900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355a7e-053b-48c1-9bac-f3030a1cb2db None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.494194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355a7e-053b-48c1-9bac-f3030a1cb2db None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.494477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355a7e-053b-48c1-9bac-f3030a1cb2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.513433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-88355a7e-053b-48c1-9bac-f3030a1cb2db None None] MFA Rules not processed for user `7973be0cfa9846afaef91c7ae1b190d2`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:08.514622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-88355a7e-053b-48c1-9bac-f3030a1cb2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:08.556072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:08.563748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 750/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Thu Jun 16 00:36:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:08.571429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56348d1a-3a42-48ed-84bf-d5d3cf4fa568 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:08.582424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56348d1a-3a42-48ed-84bf-d5d3cf4fa568 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:08.586197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236836-66cc-4932-88be-67c2a0a2f777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:08.586860 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236836-66cc-4932-88be-67c2a0a2f777 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.587148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236836-66cc-4932-88be-67c2a0a2f777 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.587432 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236836-66cc-4932-88be-67c2a0a2f777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.595898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6236836-66cc-4932-88be-67c2a0a2f777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:08.597326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6236836-66cc-4932-88be-67c2a0a2f777 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:08.605979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 755/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:36:08.649027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c3947-f712-4663-b3b9-83684f99135e None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.649352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c3947-f712-4663-b3b9-83684f99135e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.649661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c3947-f712-4663-b3b9-83684f99135e None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.650941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 751/1506] 10.222.0.27 () {52 vars in 829 bytes} [Thu Jun 16 00:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:36:08.654456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236836-66cc-4932-88be-67c2a0a2f777 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:08.714981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236836-66cc-4932-88be-67c2a0a2f777 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:08.719461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:08.720348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.720627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.720898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] PATH_INFO: `/v3/users/6f3f159cf2ed4404961b47a437c1328f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.722052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3f159cf2ed4404961b47a437c1328f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:08.723058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WARNING py.warnings [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:36:08.723058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: warnings.warn(msg) Jun 16 00:36:08.723058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: Jun 16 00:36:08.724272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:08.994204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3f159cf2ed4404961b47a437c1328f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:08.994877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3f159cf2ed4404961b47a437c1328f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:09.074055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3f159cf2ed4404961b47a437c1328f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:09.087017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3f159cf2ed4404961b47a437c1328f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:09.103450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:09.106679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3f159cf2ed4404961b47a437c1328f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:09.112728 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 756/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:08 2022] DELETE /identity/v3/users/6f3f159cf2ed4404961b47a437c1328f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:09.121985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0649646-b7be-4b22-acf0-628dc9523646 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:09.121985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0649646-b7be-4b22-acf0-628dc9523646 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:09.121985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0649646-b7be-4b22-acf0-628dc9523646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:09.135490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d0649646-b7be-4b22-acf0-628dc9523646 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:09.137570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d0649646-b7be-4b22-acf0-628dc9523646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:09.251077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 752/1508] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:09.260597 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:09.262845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:09.318239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2278e2-02cb-4385-8d26-f93605e00fe9 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:09.321776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c5d02-99cd-4619-90ef-4bb51cf7db26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:09.322415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c5d02-99cd-4619-90ef-4bb51cf7db26 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:09.322695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c5d02-99cd-4619-90ef-4bb51cf7db26 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:09.322972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c5d02-99cd-4619-90ef-4bb51cf7db26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:09.332847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c5d02-99cd-4619-90ef-4bb51cf7db26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:09.334287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c5d02-99cd-4619-90ef-4bb51cf7db26 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:09.343663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 757/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:09.915310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0649646-b7be-4b22-acf0-628dc9523646 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:09.916889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d0649646-b7be-4b22-acf0-628dc9523646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:09.929221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0649646-b7be-4b22-acf0-628dc9523646 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:09.933851 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:09.935474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:09.935946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:09.936247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] PATH_INFO: `/v3/projects/b8c216eb926e4ea4b59c044981875fe4` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:09.937552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c216eb926e4ea4b59c044981875fe4)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:09.938574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WARNING py.warnings [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:36:09.938574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: warnings.warn(msg) Jun 16 00:36:09.938574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: Jun 16 00:36:09.939796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:10.061551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c216eb926e4ea4b59c044981875fe4', 'request_id': 'req-75887ecd-a362-4af0-92a8-b30aa3c94f60'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.067810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c216eb926e4ea4b59c044981875fe4', 'request_id': 'req-75887ecd-a362-4af0-92a8-b30aa3c94f60'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.081283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c216eb926e4ea4b59c044981875fe4', 'request_id': 'req-75887ecd-a362-4af0-92a8-b30aa3c94f60'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.152962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] The token cache is being invalidate because project b8c216eb926e4ea4b59c044981875fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:10.153567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.153937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-75887ecd-a362-4af0-92a8-b30aa3c94f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.155460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 753/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:09 2022] DELETE /identity/v3/projects/b8c216eb926e4ea4b59c044981875fe4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:19.339528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:20.149360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:55.384347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32b1e-7538-4487-a2dd-c015eb96d407 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.384931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32b1e-7538-4487-a2dd-c015eb96d407 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.384931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32b1e-7538-4487-a2dd-c015eb96d407 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.386582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:37:55.391447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06624e52-a3ae-470b-b505-12ef1ce8738d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.394059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06624e52-a3ae-470b-b505-12ef1ce8738d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.394059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06624e52-a3ae-470b-b505-12ef1ce8738d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.410412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-06624e52-a3ae-470b-b505-12ef1ce8738d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:55.411610 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-06624e52-a3ae-470b-b505-12ef1ce8738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:55.470335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:55.640083 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd32b1e-7538-4487-a2dd-c015eb96d407 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.641794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-fdd32b1e-7538-4487-a2dd-c015eb96d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:55.715899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd32b1e-7538-4487-a2dd-c015eb96d407 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.721548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f658-7db6-4a57-aae9-e7269c73b259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.722179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f658-7db6-4a57-aae9-e7269c73b259 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.722465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f658-7db6-4a57-aae9-e7269c73b259 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.722744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f658-7db6-4a57-aae9-e7269c73b259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.731750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9f658-7db6-4a57-aae9-e7269c73b259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.733326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9f658-7db6-4a57-aae9-e7269c73b259 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.743065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 759/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:56.608131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4025-5d41-45d3-a20c-2715024388e0 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:56.608683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4025-5d41-45d3-a20c-2715024388e0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:56.608683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4025-5d41-45d3-a20c-2715024388e0 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:56.610048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:37:56.614762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db05a2-9563-4631-879e-4b23be9af267 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:56.615218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db05a2-9563-4631-879e-4b23be9af267 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:56.615350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db05a2-9563-4631-879e-4b23be9af267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:56.633718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-95db05a2-9563-4631-879e-4b23be9af267 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:56.634908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-95db05a2-9563-4631-879e-4b23be9af267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:56.642956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:56.796809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4025-5d41-45d3-a20c-2715024388e0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:56.812354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4025-5d41-45d3-a20c-2715024388e0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:56.818708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2dc1e-7398-43e5-a8a1-d673e90c7677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:56.819378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2dc1e-7398-43e5-a8a1-d673e90c7677 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:56.819660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2dc1e-7398-43e5-a8a1-d673e90c7677 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:56.819982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2dc1e-7398-43e5-a8a1-d673e90c7677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:56.828770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2dc1e-7398-43e5-a8a1-d673e90c7677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:56.830417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2dc1e-7398-43e5-a8a1-d673e90c7677 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:56.840253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 756/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:56.845150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2cd2-7e06-4bfe-aee6-0e8a5ca3e5f8 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:56.845516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2cd2-7e06-4bfe-aee6-0e8a5ca3e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:56.846053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2cd2-7e06-4bfe-aee6-0e8a5ca3e5f8 None None] PATH_INFO: `/v3` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:56.847430 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 761/1517] 10.222.0.30 () {54 vars in 925 bytes} [Thu Jun 16 00:37:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:56.854373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b983d-402a-47a1-bc05-229b14984c67 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:56.855183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b983d-402a-47a1-bc05-229b14984c67 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:56.855370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b983d-402a-47a1-bc05-229b14984c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:56.876468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5d7b983d-402a-47a1-bc05-229b14984c67 None None] MFA Rules not processed for user `b2e57a7647d143f5835225616138827e`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:56.877679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5d7b983d-402a-47a1-bc05-229b14984c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:56.944975 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 757/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Thu Jun 16 00:37:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:05.867890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9dbc0-2308-420d-8e0e-a7ccdf0ee299 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.868384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9dbc0-2308-420d-8e0e-a7ccdf0ee299 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.868384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9dbc0-2308-420d-8e0e-a7ccdf0ee299 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.869711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 762/1519] 10.222.0.27 () {54 vars in 960 bytes} [Thu Jun 16 00:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:38:05.874752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155688-a8e0-4c74-a003-5830e9904002 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.878133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155688-a8e0-4c74-a003-5830e9904002 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.878133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155688-a8e0-4c74-a003-5830e9904002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.894323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-de155688-a8e0-4c74-a003-5830e9904002 None None] MFA Rules not processed for user `b2e57a7647d143f5835225616138827e`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:05.894965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-de155688-a8e0-4c74-a003-5830e9904002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:05.903388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 758/1520] 10.222.0.27 () {58 vars in 1057 bytes} [Thu Jun 16 00:38:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:05.910792 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9dbc0-2308-420d-8e0e-a7ccdf0ee299 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.924616 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9dbc0-2308-420d-8e0e-a7ccdf0ee299 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.930064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965db7b-5b0b-4acd-839f-09de0eb8548d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.930687 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965db7b-5b0b-4acd-839f-09de0eb8548d service placement] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.930996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965db7b-5b0b-4acd-839f-09de0eb8548d service placement] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.931272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965db7b-5b0b-4acd-839f-09de0eb8548d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.939310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965db7b-5b0b-4acd-839f-09de0eb8548d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.940950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965db7b-5b0b-4acd-839f-09de0eb8548d service placement] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.950344 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 763/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:08.111378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60efa7-53e4-41b4-979b-9c61011b0d50 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.111936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60efa7-53e4-41b4-979b-9c61011b0d50 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.112043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60efa7-53e4-41b4-979b-9c61011b0d50 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.113366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:38:08.118111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f701-4a1b-4c9e-a745-1495dcc2f095 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.118551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f701-4a1b-4c9e-a745-1495dcc2f095 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.118676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f701-4a1b-4c9e-a745-1495dcc2f095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.137200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9f09f701-4a1b-4c9e-a745-1495dcc2f095 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:08.138474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9f09f701-4a1b-4c9e-a745-1495dcc2f095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:08.146127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:08.299939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60efa7-53e4-41b4-979b-9c61011b0d50 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:08.314827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60efa7-53e4-41b4-979b-9c61011b0d50 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:08.321045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280685f3-8330-41c1-875c-9e4bd7df53dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:08.321719 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280685f3-8330-41c1-875c-9e4bd7df53dc service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.322009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280685f3-8330-41c1-875c-9e4bd7df53dc service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.322292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280685f3-8330-41c1-875c-9e4bd7df53dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.330564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280685f3-8330-41c1-875c-9e4bd7df53dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:08.332196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280685f3-8330-41c1-875c-9e4bd7df53dc service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:08.341743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 760/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:09.197935 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f659dc-df01-4d1e-9103-99d9a218b1ae None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:09.198489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f659dc-df01-4d1e-9103-99d9a218b1ae None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:09.198489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f659dc-df01-4d1e-9103-99d9a218b1ae None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:09.199951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:38:09.204794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f7ac8-4500-485b-b705-de3cf8d1a8ef None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:09.205225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f7ac8-4500-485b-b705-de3cf8d1a8ef None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:09.205374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f7ac8-4500-485b-b705-de3cf8d1a8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:09.223552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-061f7ac8-4500-485b-b705-de3cf8d1a8ef None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:09.224777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-061f7ac8-4500-485b-b705-de3cf8d1a8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:09.233382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:09.383560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f659dc-df01-4d1e-9103-99d9a218b1ae None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:09.398283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f659dc-df01-4d1e-9103-99d9a218b1ae None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:09.403544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc57859-60eb-4b73-a5c9-8810a7ad585f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:09.404202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc57859-60eb-4b73-a5c9-8810a7ad585f service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:09.404486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc57859-60eb-4b73-a5c9-8810a7ad585f service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:09.404761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc57859-60eb-4b73-a5c9-8810a7ad585f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:09.412594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc57859-60eb-4b73-a5c9-8810a7ad585f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:09.414790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc57859-60eb-4b73-a5c9-8810a7ad585f service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:09.423951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 766/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:13.472763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafd2b4-c3a1-4aec-b6bd-1a02199d71d6 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:13.473347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafd2b4-c3a1-4aec-b6bd-1a02199d71d6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:13.473347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafd2b4-c3a1-4aec-b6bd-1a02199d71d6 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:13.474674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:38:13.480346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07e18f-ad6f-4668-a8b1-4e852ea334d0 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:13.480788 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07e18f-ad6f-4668-a8b1-4e852ea334d0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:13.480895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07e18f-ad6f-4668-a8b1-4e852ea334d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:13.501351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-de07e18f-ad6f-4668-a8b1-4e852ea334d0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:13.502532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-de07e18f-ad6f-4668-a8b1-4e852ea334d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:13.510361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:13.546377 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafd2b4-c3a1-4aec-b6bd-1a02199d71d6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:13.548081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dfafd2b4-c3a1-4aec-b6bd-1a02199d71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:13.604517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafd2b4-c3a1-4aec-b6bd-1a02199d71d6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:13.608088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c46d1-3919-4ce1-94bd-9f130a76d49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:13.608721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c46d1-3919-4ce1-94bd-9f130a76d49e service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:13.609006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c46d1-3919-4ce1-94bd-9f130a76d49e service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:13.609283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c46d1-3919-4ce1-94bd-9f130a76d49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:13.618152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c46d1-3919-4ce1-94bd-9f130a76d49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:13.619594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c46d1-3919-4ce1-94bd-9f130a76d49e service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:13.624506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:13.629093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 763/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:15.738250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba0037-6447-4e5a-aaac-7a5986de38b2 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:15.738825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba0037-6447-4e5a-aaac-7a5986de38b2 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:15.738825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba0037-6447-4e5a-aaac-7a5986de38b2 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:15.740219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:38:15.745251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eeabb-ddab-43ce-a0ba-b1841f43502d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:15.745698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eeabb-ddab-43ce-a0ba-b1841f43502d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:15.745805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eeabb-ddab-43ce-a0ba-b1841f43502d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:15.764535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-f11eeabb-ddab-43ce-a0ba-b1841f43502d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:15.765723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f11eeabb-ddab-43ce-a0ba-b1841f43502d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:15.774036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:15.809590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba0037-6447-4e5a-aaac-7a5986de38b2 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:15.820949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba0037-6447-4e5a-aaac-7a5986de38b2 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:15.824412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082b3d-a8ad-46c1-9967-d3e34fdd75f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:15.825036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082b3d-a8ad-46c1-9967-d3e34fdd75f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:15.825317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082b3d-a8ad-46c1-9967-d3e34fdd75f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:15.825589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082b3d-a8ad-46c1-9967-d3e34fdd75f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:15.834357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e082b3d-a8ad-46c1-9967-d3e34fdd75f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:15.835791 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e082b3d-a8ad-46c1-9967-d3e34fdd75f6 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:15.844925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 769/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:19.433686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76876d-196b-4683-a289-2d2eb16d974a None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:19.434292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76876d-196b-4683-a289-2d2eb16d974a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:19.434292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76876d-196b-4683-a289-2d2eb16d974a None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:19.435596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:38:19.440802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e1f35-caa2-4c12-b7d3-391cc61780ee None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:19.441261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e1f35-caa2-4c12-b7d3-391cc61780ee None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:19.441391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e1f35-caa2-4c12-b7d3-391cc61780ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:19.448913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=62 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:19.461232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-e62e1f35-caa2-4c12-b7d3-391cc61780ee None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:19.462416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e62e1f35-caa2-4c12-b7d3-391cc61780ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:19.470100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:19.733352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76876d-196b-4683-a289-2d2eb16d974a None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:19.735031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-6f76876d-196b-4683-a289-2d2eb16d974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:19.791389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76876d-196b-4683-a289-2d2eb16d974a None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:19.794919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743132a8-1594-49a2-a5fb-5ae88f7ea808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:19.795553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743132a8-1594-49a2-a5fb-5ae88f7ea808 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:19.795864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743132a8-1594-49a2-a5fb-5ae88f7ea808 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:19.796143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743132a8-1594-49a2-a5fb-5ae88f7ea808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:19.805918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743132a8-1594-49a2-a5fb-5ae88f7ea808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:19.807436 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743132a8-1594-49a2-a5fb-5ae88f7ea808 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:19.817015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 766/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:21.936130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca6bfd-e854-43b4-8a84-7bcd181bfc96 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:21.936658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca6bfd-e854-43b4-8a84-7bcd181bfc96 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:21.936783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca6bfd-e854-43b4-8a84-7bcd181bfc96 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:21.938114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:38:21.944024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727de6a-dfb7-4192-a54f-4c1e28c3aa98 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:21.944024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727de6a-dfb7-4192-a54f-4c1e28c3aa98 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:21.945166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727de6a-dfb7-4192-a54f-4c1e28c3aa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:21.964445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e727de6a-dfb7-4192-a54f-4c1e28c3aa98 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:21.965715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e727de6a-dfb7-4192-a54f-4c1e28c3aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:21.973827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:22.243016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca6bfd-e854-43b4-8a84-7bcd181bfc96 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:22.244744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-85ca6bfd-e854-43b4-8a84-7bcd181bfc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:22.258595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca6bfd-e854-43b4-8a84-7bcd181bfc96 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:22.264156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899cffb-a24d-4b0e-b585-84db9e1f3f61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:22.264156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899cffb-a24d-4b0e-b585-84db9e1f3f61 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:22.264156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899cffb-a24d-4b0e-b585-84db9e1f3f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:22.264156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899cffb-a24d-4b0e-b585-84db9e1f3f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:22.272569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899cffb-a24d-4b0e-b585-84db9e1f3f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:22.274474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899cffb-a24d-4b0e-b585-84db9e1f3f61 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:22.283863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 772/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:31.958961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=32 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:32.279760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=8 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:52.612224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d0ebd-5af8-4df7-b86d-a07f7de9bd9e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:52.612861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d0ebd-5af8-4df7-b86d-a07f7de9bd9e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:52.612861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d0ebd-5af8-4df7-b86d-a07f7de9bd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:52.635773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a16d0ebd-5af8-4df7-b86d-a07f7de9bd9e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:52.637843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a16d0ebd-5af8-4df7-b86d-a07f7de9bd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:52.650794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 768/1540] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:39:52.661232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a31da-5295-47b7-819a-1db0ec3541b3 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:52.661798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a31da-5295-47b7-819a-1db0ec3541b3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:52.661798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a31da-5295-47b7-819a-1db0ec3541b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:52.692816 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-903a31da-5295-47b7-819a-1db0ec3541b3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:52.694034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-903a31da-5295-47b7-819a-1db0ec3541b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:52.703284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 773/1541] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:52.708059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d0ebd-5af8-4df7-b86d-a07f7de9bd9e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:52.721056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d0ebd-5af8-4df7-b86d-a07f7de9bd9e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:52.725792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1e0b6-ee01-4dda-851f-6e2232285a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:52.726585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1e0b6-ee01-4dda-851f-6e2232285a6c admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:52.726873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1e0b6-ee01-4dda-851f-6e2232285a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:52.727176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1e0b6-ee01-4dda-851f-6e2232285a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:52.727929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1e0b6-ee01-4dda-851f-6e2232285a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:39:52.728240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1e0b6-ee01-4dda-851f-6e2232285a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:52.729880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1e0b6-ee01-4dda-851f-6e2232285a6c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:52.747605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 769/1542] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:39:52.755959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a31da-5295-47b7-819a-1db0ec3541b3 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:52.769046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a31da-5295-47b7-819a-1db0ec3541b3 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:52.776330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84560e9-fe56-4edf-9163-5c6185486aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:52.776999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84560e9-fe56-4edf-9163-5c6185486aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:52.777284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84560e9-fe56-4edf-9163-5c6185486aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:52.777562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84560e9-fe56-4edf-9163-5c6185486aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:52.778429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84560e9-fe56-4edf-9163-5c6185486aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:52.780399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84560e9-fe56-4edf-9163-5c6185486aa1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:52.867747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 774/1543] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:52 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:52.872883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1e0b6-ee01-4dda-851f-6e2232285a6c admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:52.884722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1e0b6-ee01-4dda-851f-6e2232285a6c admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:52.963217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555b0e4-8399-4344-b479-8c87fb636cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:52.965065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555b0e4-8399-4344-b479-8c87fb636cfe admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:52.965065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555b0e4-8399-4344-b479-8c87fb636cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:52.965065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555b0e4-8399-4344-b479-8c87fb636cfe admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:52.965065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555b0e4-8399-4344-b479-8c87fb636cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:52.967069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555b0e4-8399-4344-b479-8c87fb636cfe admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.085973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 770/1544] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:52 2022] POST /identity/v3/users => generated 295 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:53.091052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84560e9-fe56-4edf-9163-5c6185486aa1 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.108741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84560e9-fe56-4edf-9163-5c6185486aa1 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.117588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d22c36-f596-48cc-ab4b-d7b5a46e6821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.118412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d22c36-f596-48cc-ab4b-d7b5a46e6821 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.118638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d22c36-f596-48cc-ab4b-d7b5a46e6821 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.119191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d22c36-f596-48cc-ab4b-d7b5a46e6821 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.119975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d22c36-f596-48cc-ab4b-d7b5a46e6821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.121737 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d22c36-f596-48cc-ab4b-d7b5a46e6821 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.139941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 775/1545] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:53.144262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555b0e4-8399-4344-b479-8c87fb636cfe admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.162999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555b0e4-8399-4344-b479-8c87fb636cfe admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.172836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a61e50-e537-4ddb-83b0-cbf16a55e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.173522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61e50-e537-4ddb-83b0-cbf16a55e7bf admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.173805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61e50-e537-4ddb-83b0-cbf16a55e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.174085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61e50-e537-4ddb-83b0-cbf16a55e7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.174812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a61e50-e537-4ddb-83b0-cbf16a55e7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.176494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a61e50-e537-4ddb-83b0-cbf16a55e7bf admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.191852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 771/1546] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:53.196588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d22c36-f596-48cc-ab4b-d7b5a46e6821 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.211529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d22c36-f596-48cc-ab4b-d7b5a46e6821 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.225327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07b50a-a679-4196-a4c7-370ac77ebea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.226254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b50a-a679-4196-a4c7-370ac77ebea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.226538 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b50a-a679-4196-a4c7-370ac77ebea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.226818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b50a-a679-4196-a4c7-370ac77ebea1 admin admin] PATH_INFO: `/v3/projects/d915343c20044be188d225f96446adf1/users/eb6d9398095c426f9d39eef485c45c66/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.242516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bcb12-42be-4b0b-b28a-561a1f7fe330 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.242860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bcb12-42be-4b0b-b28a-561a1f7fe330 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.243080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bcb12-42be-4b0b-b28a-561a1f7fe330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.252746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07b50a-a679-4196-a4c7-370ac77ebea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d915343c20044be188d225f96446adf1, user_id=eb6d9398095c426f9d39eef485c45c66, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.255450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07b50a-a679-4196-a4c7-370ac77ebea1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.280991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-180bcb12-42be-4b0b-b28a-561a1f7fe330 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.282630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-180bcb12-42be-4b0b-b28a-561a1f7fe330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.299447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 772/1547] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.314959 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bdade-e6b5-479d-b9a1-0d01caa40264 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.315252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bdade-e6b5-479d-b9a1-0d01caa40264 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.315536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bdade-e6b5-479d-b9a1-0d01caa40264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.333066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 776/1548] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:53 2022] PUT /identity/v3/projects/d915343c20044be188d225f96446adf1/users/eb6d9398095c426f9d39eef485c45c66/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:53.338491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e2191-637c-4bd3-affd-90cd286f3d30 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.338819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e2191-637c-4bd3-affd-90cd286f3d30 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.339059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e2191-637c-4bd3-affd-90cd286f3d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.344134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-067bdade-e6b5-479d-b9a1-0d01caa40264 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.345485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-067bdade-e6b5-479d-b9a1-0d01caa40264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.374828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-df5e2191-637c-4bd3-affd-90cd286f3d30 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.376239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-df5e2191-637c-4bd3-affd-90cd286f3d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.437130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 773/1549] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:39:53.438376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143567c6-c920-4f76-ad6f-af7f19fe8e9d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.438668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143567c6-c920-4f76-ad6f-af7f19fe8e9d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.438944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143567c6-c920-4f76-ad6f-af7f19fe8e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.476502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-143567c6-c920-4f76-ad6f-af7f19fe8e9d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.478650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-143567c6-c920-4f76-ad6f-af7f19fe8e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.497044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 774/1550] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.499512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56503737-9bd8-4c12-9329-1a1595d46162 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.499827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56503737-9bd8-4c12-9329-1a1595d46162 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.500111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56503737-9bd8-4c12-9329-1a1595d46162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.510623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 777/1551] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:39:53.512645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e2191-637c-4bd3-affd-90cd286f3d30 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.530127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e2191-637c-4bd3-affd-90cd286f3d30 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.541685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-56503737-9bd8-4c12-9329-1a1595d46162 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.541932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f73ac-bc94-4e08-a546-d56e87681f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.542906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f73ac-bc94-4e08-a546-d56e87681f80 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.544959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f73ac-bc94-4e08-a546-d56e87681f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.545283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f73ac-bc94-4e08-a546-d56e87681f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.545551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-56503737-9bd8-4c12-9329-1a1595d46162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.546040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f73ac-bc94-4e08-a546-d56e87681f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:39:53.546363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f73ac-bc94-4e08-a546-d56e87681f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.547423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WARNING py.warnings [None req-1a3f73ac-bc94-4e08-a546-d56e87681f80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:39:53.547423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: warnings.warn(msg) Jun 16 00:39:53.547423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: Jun 16 00:39:53.548349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f73ac-bc94-4e08-a546-d56e87681f80 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.562035 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 775/1552] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.563786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1bb6-200d-4d3d-ba4b-c25c32da5e6b None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.564303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1bb6-200d-4d3d-ba4b-c25c32da5e6b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.564689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1bb6-200d-4d3d-ba4b-c25c32da5e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.567058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 778/1553] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:39:53.572069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95101b8-56d9-4985-b1ef-18778b64a80c None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.572367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95101b8-56d9-4985-b1ef-18778b64a80c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.572648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95101b8-56d9-4985-b1ef-18778b64a80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.593473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d95101b8-56d9-4985-b1ef-18778b64a80c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.593473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d95101b8-56d9-4985-b1ef-18778b64a80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.594408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d12b1bb6-200d-4d3d-ba4b-c25c32da5e6b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.595893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d12b1bb6-200d-4d3d-ba4b-c25c32da5e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.600558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 779/1554] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.601342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95101b8-56d9-4985-b1ef-18778b64a80c None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.604363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 776/1555] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.606328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390670-8eb4-4849-b856-9272eb49e008 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.606619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390670-8eb4-4849-b856-9272eb49e008 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.606898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390670-8eb4-4849-b856-9272eb49e008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.627346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5b390670-8eb4-4849-b856-9272eb49e008 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.628521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5b390670-8eb4-4849-b856-9272eb49e008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.637094 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 777/1556] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.638303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ff2f-d792-4067-aad5-22b590b2c47d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.638608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ff2f-d792-4067-aad5-22b590b2c47d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.638897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ff2f-d792-4067-aad5-22b590b2c47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.657111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-dee7ff2f-d792-4067-aad5-22b590b2c47d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.658732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dee7ff2f-d792-4067-aad5-22b590b2c47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.659914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95101b8-56d9-4985-b1ef-18778b64a80c None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.663499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd0e8c-a663-4403-9273-bd1a6b7d037d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.664170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0e8c-a663-4403-9273-bd1a6b7d037d service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.664517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0e8c-a663-4403-9273-bd1a6b7d037d service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.664720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0e8c-a663-4403-9273-bd1a6b7d037d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.666816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 778/1557] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.669514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74078-0b41-4f50-ab44-52862f7553b8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.669810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74078-0b41-4f50-ab44-52862f7553b8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.670088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74078-0b41-4f50-ab44-52862f7553b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.674825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd0e8c-a663-4403-9273-bd1a6b7d037d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.676603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd0e8c-a663-4403-9273-bd1a6b7d037d service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.688227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 780/1558] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:53.689024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd0e8c-a663-4403-9273-bd1a6b7d037d service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.691720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-42d74078-0b41-4f50-ab44-52862f7553b8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.691720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-42d74078-0b41-4f50-ab44-52862f7553b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.698461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd0e8c-a663-4403-9273-bd1a6b7d037d service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.704113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 779/1559] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.704113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f44a7-7d51-4d1f-b36e-b6c1699f69fa None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.704113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f44a7-7d51-4d1f-b36e-b6c1699f69fa None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.704113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f44a7-7d51-4d1f-b36e-b6c1699f69fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.708197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba416e5-8b4e-4ba3-9981-c7f35f07f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.708885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba416e5-8b4e-4ba3-9981-c7f35f07f695 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.709142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba416e5-8b4e-4ba3-9981-c7f35f07f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.709419 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba416e5-8b4e-4ba3-9981-c7f35f07f695 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.710282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba416e5-8b4e-4ba3-9981-c7f35f07f695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.712231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba416e5-8b4e-4ba3-9981-c7f35f07f695 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.724151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-f28f44a7-7d51-4d1f-b36e-b6c1699f69fa None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.726181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f28f44a7-7d51-4d1f-b36e-b6c1699f69fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.734477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 780/1560] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.735250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f44a7-7d51-4d1f-b36e-b6c1699f69fa None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.744583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f44a7-7d51-4d1f-b36e-b6c1699f69fa None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.749905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6a9b0-1ac4-4d4b-a540-49bdbdbc60eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.754255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6a9b0-1ac4-4d4b-a540-49bdbdbc60eb admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.754255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6a9b0-1ac4-4d4b-a540-49bdbdbc60eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.754255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6a9b0-1ac4-4d4b-a540-49bdbdbc60eb admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.754255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6a9b0-1ac4-4d4b-a540-49bdbdbc60eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:39:53.754255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6a9b0-1ac4-4d4b-a540-49bdbdbc60eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.754255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6a9b0-1ac4-4d4b-a540-49bdbdbc60eb admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.755256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:53.768652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 781/1561] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:39:53.768652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7ae6-8734-46ce-8496-e66d5914e55c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.768652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7ae6-8734-46ce-8496-e66d5914e55c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.768652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf7ae6-8734-46ce-8496-e66d5914e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.784446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-27cf7ae6-8734-46ce-8496-e66d5914e55c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.788579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-27cf7ae6-8734-46ce-8496-e66d5914e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.794138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 782/1562] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.795336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7b96-4ade-4f03-a583-5ea5b83dffa8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.795620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7b96-4ade-4f03-a583-5ea5b83dffa8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.796002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7b96-4ade-4f03-a583-5ea5b83dffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.806141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:53.814864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d93a7b96-4ade-4f03-a583-5ea5b83dffa8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.815081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 781/1563] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:53.816424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d93a7b96-4ade-4f03-a583-5ea5b83dffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.820227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84021e-2a80-48cd-8927-de76eb4511a1 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.820227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84021e-2a80-48cd-8927-de76eb4511a1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.820556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84021e-2a80-48cd-8927-de76eb4511a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.842350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-bb84021e-2a80-48cd-8927-de76eb4511a1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.843554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-bb84021e-2a80-48cd-8927-de76eb4511a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.880707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 783/1564] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.881495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7b96-4ade-4f03-a583-5ea5b83dffa8 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.891257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7b96-4ade-4f03-a583-5ea5b83dffa8 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.895947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d435a8-f773-487e-ab48-ceca70782454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.900782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d435a8-f773-487e-ab48-ceca70782454 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.900782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d435a8-f773-487e-ab48-ceca70782454 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.900782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d435a8-f773-487e-ab48-ceca70782454 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.900782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d435a8-f773-487e-ab48-ceca70782454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:39:53.900782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d435a8-f773-487e-ab48-ceca70782454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.900782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d435a8-f773-487e-ab48-ceca70782454 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.910443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 782/1565] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.911998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ae36d-edc8-433a-ba96-72826a0b6658 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.912328 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ae36d-edc8-433a-ba96-72826a0b6658 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.912604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ae36d-edc8-433a-ba96-72826a0b6658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.914158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 784/1566] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:39:53.915240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d435a8-f773-487e-ab48-ceca70782454 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.925994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d435a8-f773-487e-ab48-ceca70782454 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.930546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9445e53-9ded-402d-ae6d-161ab3e6e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.931186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9445e53-9ded-402d-ae6d-161ab3e6e196 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.931465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9445e53-9ded-402d-ae6d-161ab3e6e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.931763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9445e53-9ded-402d-ae6d-161ab3e6e196 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.932442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9445e53-9ded-402d-ae6d-161ab3e6e196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.933456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WARNING py.warnings [None req-e9445e53-9ded-402d-ae6d-161ab3e6e196 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:39:53.933456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: warnings.warn(msg) Jun 16 00:39:53.933456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: Jun 16 00:39:53.933807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-af7ae36d-edc8-433a-ba96-72826a0b6658 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:53.934673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9445e53-9ded-402d-ae6d-161ab3e6e196 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.935061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-af7ae36d-edc8-433a-ba96-72826a0b6658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:53.943064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 783/1567] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:53.947482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ae36d-edc8-433a-ba96-72826a0b6658 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.957032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ae36d-edc8-433a-ba96-72826a0b6658 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:53.961557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f0bea-4fac-4d18-8112-0619152292bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:53.962207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f0bea-4fac-4d18-8112-0619152292bc admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:53.962488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f0bea-4fac-4d18-8112-0619152292bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:53.962758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f0bea-4fac-4d18-8112-0619152292bc admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:53.963495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f0bea-4fac-4d18-8112-0619152292bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:39:53.964185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f0bea-4fac-4d18-8112-0619152292bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:53.966006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f0bea-4fac-4d18-8112-0619152292bc admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:53.978709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 784/1568] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:39:53.979695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f0bea-4fac-4d18-8112-0619152292bc admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:53.997353 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f0bea-4fac-4d18-8112-0619152292bc admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.001974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57324c47-a34c-45f8-a6f3-ad89d939ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.002634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57324c47-a34c-45f8-a6f3-ad89d939ba73 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.002921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57324c47-a34c-45f8-a6f3-ad89d939ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.003193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57324c47-a34c-45f8-a6f3-ad89d939ba73 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.003972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57324c47-a34c-45f8-a6f3-ad89d939ba73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.006393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WARNING py.warnings [None req-57324c47-a34c-45f8-a6f3-ad89d939ba73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:39:54.006393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: warnings.warn(msg) Jun 16 00:39:54.006393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: Jun 16 00:39:54.006393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57324c47-a34c-45f8-a6f3-ad89d939ba73 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.041961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 785/1569] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.042657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9445e53-9ded-402d-ae6d-161ab3e6e196 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.105643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9445e53-9ded-402d-ae6d-161ab3e6e196 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.110937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469133f-9d0e-4f26-aef5-1d7937be69fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.111644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469133f-9d0e-4f26-aef5-1d7937be69fc admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.111952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469133f-9d0e-4f26-aef5-1d7937be69fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.112235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469133f-9d0e-4f26-aef5-1d7937be69fc admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.112983 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469133f-9d0e-4f26-aef5-1d7937be69fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:39:54.113291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469133f-9d0e-4f26-aef5-1d7937be69fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.114940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469133f-9d0e-4f26-aef5-1d7937be69fc admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.125962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 785/1570] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:53 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.133518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 786/1571] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:39:54.133696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57324c47-a34c-45f8-a6f3-ad89d939ba73 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.133814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469133f-9d0e-4f26-aef5-1d7937be69fc admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.139182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469133f-9d0e-4f26-aef5-1d7937be69fc admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.139390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57324c47-a34c-45f8-a6f3-ad89d939ba73 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.143924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb71b7-876f-4fb5-bc9d-222de0206cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.144114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbc435-1e3f-46b9-a810-36450ef5c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.144786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb71b7-876f-4fb5-bc9d-222de0206cbd admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.144906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbc435-1e3f-46b9-a810-36450ef5c4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.145160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbc435-1e3f-46b9-a810-36450ef5c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.145438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbc435-1e3f-46b9-a810-36450ef5c4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.145535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb71b7-876f-4fb5-bc9d-222de0206cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.145898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb71b7-876f-4fb5-bc9d-222de0206cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.146171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbc435-1e3f-46b9-a810-36450ef5c4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:39:54.146469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbc435-1e3f-46b9-a810-36450ef5c4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.146851 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb71b7-876f-4fb5-bc9d-222de0206cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.148373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbc435-1e3f-46b9-a810-36450ef5c4a9 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.149489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb71b7-876f-4fb5-bc9d-222de0206cbd admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.162754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 786/1572] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:39:54.164059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbc435-1e3f-46b9-a810-36450ef5c4a9 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.176898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbc435-1e3f-46b9-a810-36450ef5c4a9 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.181778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55632d36-143a-49c5-898e-be20892dc6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.182639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55632d36-143a-49c5-898e-be20892dc6cf admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.182925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55632d36-143a-49c5-898e-be20892dc6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.183204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55632d36-143a-49c5-898e-be20892dc6cf admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.184116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55632d36-143a-49c5-898e-be20892dc6cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:39:54.184427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55632d36-143a-49c5-898e-be20892dc6cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.186066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55632d36-143a-49c5-898e-be20892dc6cf admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.198227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 787/1573] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:39:54.198920 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55632d36-143a-49c5-898e-be20892dc6cf admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.213501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55632d36-143a-49c5-898e-be20892dc6cf admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.218258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2060c6-f259-49c1-8e42-cb10835d05e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.218997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2060c6-f259-49c1-8e42-cb10835d05e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.219275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2060c6-f259-49c1-8e42-cb10835d05e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.219553 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2060c6-f259-49c1-8e42-cb10835d05e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.220303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2060c6-f259-49c1-8e42-cb10835d05e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.222210 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2060c6-f259-49c1-8e42-cb10835d05e3 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.322135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 788/1575] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.326768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 787/1575] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.326768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb71b7-876f-4fb5-bc9d-222de0206cbd admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.327013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2060c6-f259-49c1-8e42-cb10835d05e3 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.351454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:54.386165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb71b7-876f-4fb5-bc9d-222de0206cbd admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.388996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2060c6-f259-49c1-8e42-cb10835d05e3 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.391220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ec7d-642e-4fd4-9394-8f5b76f3f89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.391974 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ec7d-642e-4fd4-9394-8f5b76f3f89f admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.395474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ec7d-642e-4fd4-9394-8f5b76f3f89f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.395474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ec7d-642e-4fd4-9394-8f5b76f3f89f admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.395474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ec7d-642e-4fd4-9394-8f5b76f3f89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.395780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df66b2f-e241-43a8-9065-f517e44c4c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.395780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66b2f-e241-43a8-9065-f517e44c4c54 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.395780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66b2f-e241-43a8-9065-f517e44c4c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.395780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66b2f-e241-43a8-9065-f517e44c4c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.396146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ec7d-642e-4fd4-9394-8f5b76f3f89f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.396240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df66b2f-e241-43a8-9065-f517e44c4c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.397662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df66b2f-e241-43a8-9065-f517e44c4c54 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.408351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 789/1576] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:54.409169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df66b2f-e241-43a8-9065-f517e44c4c54 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.419471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df66b2f-e241-43a8-9065-f517e44c4c54 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.424498 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352ba3-0e52-40b7-84e2-1c0f3f390ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.425176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352ba3-0e52-40b7-84e2-1c0f3f390ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.425462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352ba3-0e52-40b7-84e2-1c0f3f390ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.425773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352ba3-0e52-40b7-84e2-1c0f3f390ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.426474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a352ba3-0e52-40b7-84e2-1c0f3f390ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.428646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a352ba3-0e52-40b7-84e2-1c0f3f390ea6 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.433288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:54.470138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 788/1577] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.471124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ec7d-642e-4fd4-9394-8f5b76f3f89f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.482524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ec7d-642e-4fd4-9394-8f5b76f3f89f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.487312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b26fa-3d83-46fc-9404-ff29dd306677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.488012 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b26fa-3d83-46fc-9404-ff29dd306677 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.488297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b26fa-3d83-46fc-9404-ff29dd306677 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.488575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b26fa-3d83-46fc-9404-ff29dd306677 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.489265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b26fa-3d83-46fc-9404-ff29dd306677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.491183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b26fa-3d83-46fc-9404-ff29dd306677 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.533683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 790/1578] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.534501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352ba3-0e52-40b7-84e2-1c0f3f390ea6 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.591814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 789/1579] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.593089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b26fa-3d83-46fc-9404-ff29dd306677 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.600354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352ba3-0e52-40b7-84e2-1c0f3f390ea6 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.658500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b26fa-3d83-46fc-9404-ff29dd306677 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.663040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ab84-f76b-4252-83ab-ca142877879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.663228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf1a2-ae85-4f3a-9670-8a23f8a99cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.663906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ab84-f76b-4252-83ab-ca142877879f admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.664300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf1a2-ae85-4f3a-9670-8a23f8a99cfc admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.664300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf1a2-ae85-4f3a-9670-8a23f8a99cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.664490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ab84-f76b-4252-83ab-ca142877879f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.664587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf1a2-ae85-4f3a-9670-8a23f8a99cfc admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.664719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ab84-f76b-4252-83ab-ca142877879f admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.665122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecf1a2-ae85-4f3a-9670-8a23f8a99cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.665563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999ab84-f76b-4252-83ab-ca142877879f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.667099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecf1a2-ae85-4f3a-9670-8a23f8a99cfc admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.667654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999ab84-f76b-4252-83ab-ca142877879f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.760426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 790/1580] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.761661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf1a2-ae85-4f3a-9670-8a23f8a99cfc admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.765451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 791/1581] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/projects => generated 365 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.766576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ab84-f76b-4252-83ab-ca142877879f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.774557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf1a2-ae85-4f3a-9670-8a23f8a99cfc admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.836443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ab84-f76b-4252-83ab-ca142877879f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.842239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f0c1-43c3-420b-968d-43e39cd9539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.842404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf3523-00f0-4748-97af-1af01f7b73fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.842925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f0c1-43c3-420b-968d-43e39cd9539a admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.843190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf3523-00f0-4748-97af-1af01f7b73fc admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.843299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f0c1-43c3-420b-968d-43e39cd9539a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.843498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f0c1-43c3-420b-968d-43e39cd9539a admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.843602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf3523-00f0-4748-97af-1af01f7b73fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.843763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf3523-00f0-4748-97af-1af01f7b73fc admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.844195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114f0c1-43c3-420b-968d-43e39cd9539a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.848721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf3523-00f0-4748-97af-1af01f7b73fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.848721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf3523-00f0-4748-97af-1af01f7b73fc admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.848925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114f0c1-43c3-420b-968d-43e39cd9539a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.857042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 792/1582] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:54.857858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf3523-00f0-4748-97af-1af01f7b73fc admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.867062 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf3523-00f0-4748-97af-1af01f7b73fc admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.871625 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681870b-0a98-481f-9edc-03899fb0c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.872278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681870b-0a98-481f-9edc-03899fb0c41d admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.872565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681870b-0a98-481f-9edc-03899fb0c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.877459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681870b-0a98-481f-9edc-03899fb0c41d admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.877459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681870b-0a98-481f-9edc-03899fb0c41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.877459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681870b-0a98-481f-9edc-03899fb0c41d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.884694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 793/1583] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:54.885435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681870b-0a98-481f-9edc-03899fb0c41d admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.891535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:54.895269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681870b-0a98-481f-9edc-03899fb0c41d admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.900013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5457b-ffd3-4ce0-a7e6-5df8fc56f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.900651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5457b-ffd3-4ce0-a7e6-5df8fc56f52f admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.900932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5457b-ffd3-4ce0-a7e6-5df8fc56f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.901211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5457b-ffd3-4ce0-a7e6-5df8fc56f52f admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.901879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5457b-ffd3-4ce0-a7e6-5df8fc56f52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.904314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5457b-ffd3-4ce0-a7e6-5df8fc56f52f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.938598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 791/1584] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:54.939264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f0c1-43c3-420b-968d-43e39cd9539a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:54.948970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f0c1-43c3-420b-968d-43e39cd9539a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:54.954130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87568fb8-dcff-4130-960c-d8391e311f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:54.954772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87568fb8-dcff-4130-960c-d8391e311f1c admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:54.955061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87568fb8-dcff-4130-960c-d8391e311f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:54.955340 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87568fb8-dcff-4130-960c-d8391e311f1c admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:54.956047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87568fb8-dcff-4130-960c-d8391e311f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:54.957965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87568fb8-dcff-4130-960c-d8391e311f1c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:54.966996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:55.019381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 794/1585] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:55.020309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5457b-ffd3-4ce0-a7e6-5df8fc56f52f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.030542 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5457b-ffd3-4ce0-a7e6-5df8fc56f52f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.035409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4518c-e246-4961-91c1-63e5e9a0691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.036102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4518c-e246-4961-91c1-63e5e9a0691f admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.036385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4518c-e246-4961-91c1-63e5e9a0691f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.036664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4518c-e246-4961-91c1-63e5e9a0691f admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.037382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4518c-e246-4961-91c1-63e5e9a0691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.038972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4518c-e246-4961-91c1-63e5e9a0691f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.049050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 792/1586] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:54 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:55.049509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87568fb8-dcff-4130-960c-d8391e311f1c admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.061685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87568fb8-dcff-4130-960c-d8391e311f1c admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.062290 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 795/1587] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.063267 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4518c-e246-4961-91c1-63e5e9a0691f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.071013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585d36e-58d6-452a-a2c1-69bbd33027fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.071710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585d36e-58d6-452a-a2c1-69bbd33027fd admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.072089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585d36e-58d6-452a-a2c1-69bbd33027fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.072370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585d36e-58d6-452a-a2c1-69bbd33027fd admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.073052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585d36e-58d6-452a-a2c1-69bbd33027fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.074208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4518c-e246-4961-91c1-63e5e9a0691f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.075485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585d36e-58d6-452a-a2c1-69bbd33027fd admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.080180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6f8b-ca92-456f-97b9-36c67bc9b8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.081346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6f8b-ca92-456f-97b9-36c67bc9b8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.081801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6f8b-ca92-456f-97b9-36c67bc9b8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.081801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6f8b-ca92-456f-97b9-36c67bc9b8c1 admin admin] PATH_INFO: `/v3/projects/8d3732c0d6e240d7bafacef301592487/users/0dd27b6f42d3412e94e582391a00474c/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.097739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6f8b-ca92-456f-97b9-36c67bc9b8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3732c0d6e240d7bafacef301592487, user_id=0dd27b6f42d3412e94e582391a00474c, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.100429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6f8b-ca92-456f-97b9-36c67bc9b8c1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.176610 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 793/1588] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:55 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:55.176610 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585d36e-58d6-452a-a2c1-69bbd33027fd admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.179060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585d36e-58d6-452a-a2c1-69bbd33027fd admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.185301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8910d98-fff2-439c-8e04-1a1d70eb5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.186048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8910d98-fff2-439c-8e04-1a1d70eb5ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.186428 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8910d98-fff2-439c-8e04-1a1d70eb5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.186800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8910d98-fff2-439c-8e04-1a1d70eb5ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.187625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8910d98-fff2-439c-8e04-1a1d70eb5ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.189364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8910d98-fff2-439c-8e04-1a1d70eb5ae2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.200097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 794/1589] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.201018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8910d98-fff2-439c-8e04-1a1d70eb5ae2 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.211718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8910d98-fff2-439c-8e04-1a1d70eb5ae2 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.216969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f79e2-c5dd-4172-bcf6-a631834c4b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.217698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f79e2-c5dd-4172-bcf6-a631834c4b35 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.218047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f79e2-c5dd-4172-bcf6-a631834c4b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.218388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f79e2-c5dd-4172-bcf6-a631834c4b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.219156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f79e2-c5dd-4172-bcf6-a631834c4b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.220870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f79e2-c5dd-4172-bcf6-a631834c4b35 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.231400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 795/1590] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.232458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f79e2-c5dd-4172-bcf6-a631834c4b35 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.242167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f79e2-c5dd-4172-bcf6-a631834c4b35 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.247503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214c457-9bec-485a-ba42-4f765680c100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.248176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c457-9bec-485a-ba42-4f765680c100 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.248465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c457-9bec-485a-ba42-4f765680c100 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.248743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c457-9bec-485a-ba42-4f765680c100 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.249500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c457-9bec-485a-ba42-4f765680c100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.251130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c457-9bec-485a-ba42-4f765680c100 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.262934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 796/1591] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.263949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214c457-9bec-485a-ba42-4f765680c100 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.272514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 796/1592] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:55 2022] PUT /identity/v3/projects/8d3732c0d6e240d7bafacef301592487/users/0dd27b6f42d3412e94e582391a00474c/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:55.276666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6f8b-ca92-456f-97b9-36c67bc9b8c1 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.279658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214c457-9bec-485a-ba42-4f765680c100 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.344121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6f8b-ca92-456f-97b9-36c67bc9b8c1 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.349383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146caec6-e1d1-4a6b-a19c-be75caefb7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.354418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146caec6-e1d1-4a6b-a19c-be75caefb7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.354418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146caec6-e1d1-4a6b-a19c-be75caefb7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.354418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146caec6-e1d1-4a6b-a19c-be75caefb7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.354418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146caec6-e1d1-4a6b-a19c-be75caefb7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.354418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146caec6-e1d1-4a6b-a19c-be75caefb7f9 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.363680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e453f-08b2-4d9c-9bf6-edfaa242af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.365149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e453f-08b2-4d9c-9bf6-edfaa242af32 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.365149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e453f-08b2-4d9c-9bf6-edfaa242af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.365149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e453f-08b2-4d9c-9bf6-edfaa242af32 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.365713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 797/1593] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.366767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146caec6-e1d1-4a6b-a19c-be75caefb7f9 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.368497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e453f-08b2-4d9c-9bf6-edfaa242af32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.370617 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e453f-08b2-4d9c-9bf6-edfaa242af32 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.380587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146caec6-e1d1-4a6b-a19c-be75caefb7f9 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.385595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 797/1594] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.385595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e453f-08b2-4d9c-9bf6-edfaa242af32 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.386605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52451ec-7249-429f-aa84-48a2c05b9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.387909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52451ec-7249-429f-aa84-48a2c05b9aea admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.388605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52451ec-7249-429f-aa84-48a2c05b9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.388605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52451ec-7249-429f-aa84-48a2c05b9aea admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.389154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52451ec-7249-429f-aa84-48a2c05b9aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.390762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52451ec-7249-429f-aa84-48a2c05b9aea admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.398296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e453f-08b2-4d9c-9bf6-edfaa242af32 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.403770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 798/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.403770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52451ec-7249-429f-aa84-48a2c05b9aea admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.405509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5027e-28b1-4a17-8e17-3b7f47914a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.406403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5027e-28b1-4a17-8e17-3b7f47914a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.406690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5027e-28b1-4a17-8e17-3b7f47914a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.406971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5027e-28b1-4a17-8e17-3b7f47914a5d admin admin] PATH_INFO: `/v3/projects/9fae05751a6041c48ef1d88301ada7f0/users/ad32647c40854a77af7f1770f96653b7/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.414238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52451ec-7249-429f-aa84-48a2c05b9aea admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.419053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93d27e-8d99-4ece-80ba-a9efa5bb7be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.419892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d27e-8d99-4ece-80ba-a9efa5bb7be8 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.420057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d27e-8d99-4ece-80ba-a9efa5bb7be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.420414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d27e-8d99-4ece-80ba-a9efa5bb7be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.421135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93d27e-8d99-4ece-80ba-a9efa5bb7be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.422844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93d27e-8d99-4ece-80ba-a9efa5bb7be8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.424717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5027e-28b1-4a17-8e17-3b7f47914a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fae05751a6041c48ef1d88301ada7f0, user_id=ad32647c40854a77af7f1770f96653b7, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.425779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WARNING py.warnings [None req-c4f5027e-28b1-4a17-8e17-3b7f47914a5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:39:55.425779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: warnings.warn(msg) Jun 16 00:39:55.425779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: Jun 16 00:39:55.427725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5027e-28b1-4a17-8e17-3b7f47914a5d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.435093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 799/1596] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.435987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93d27e-8d99-4ece-80ba-a9efa5bb7be8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.445671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93d27e-8d99-4ece-80ba-a9efa5bb7be8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.450882 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129db5-dc5f-498d-aea1-2d1dac36b9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.451526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129db5-dc5f-498d-aea1-2d1dac36b9ab admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.451836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129db5-dc5f-498d-aea1-2d1dac36b9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.452114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129db5-dc5f-498d-aea1-2d1dac36b9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.452877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129db5-dc5f-498d-aea1-2d1dac36b9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.454453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129db5-dc5f-498d-aea1-2d1dac36b9ab admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.464710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 800/1597] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.466088 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f49e5-0095-498b-92ff-cb5fab9fa0be None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.466379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f49e5-0095-498b-92ff-cb5fab9fa0be None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.466652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f49e5-0095-498b-92ff-cb5fab9fa0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.484134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-452f49e5-0095-498b-92ff-cb5fab9fa0be None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:55.485388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-452f49e5-0095-498b-92ff-cb5fab9fa0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:55.493150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 801/1598] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:55.494026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f49e5-0095-498b-92ff-cb5fab9fa0be None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.504913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f49e5-0095-498b-92ff-cb5fab9fa0be None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.509499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046fc1-76b2-4d57-9bc8-992491494d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.518834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046fc1-76b2-4d57-9bc8-992491494d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.518834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046fc1-76b2-4d57-9bc8-992491494d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.518834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046fc1-76b2-4d57-9bc8-992491494d11 admin admin] PATH_INFO: `/v3/projects/2aa36ad3985147bea21fb375453ab8cf/users/1616dff84f03410f9b8a1c1c3b853b90/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.526798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17046fc1-76b2-4d57-9bc8-992491494d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa36ad3985147bea21fb375453ab8cf, user_id=1616dff84f03410f9b8a1c1c3b853b90, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.529642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17046fc1-76b2-4d57-9bc8-992491494d11 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.543448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 798/1599] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:55 2022] PUT /identity/v3/projects/9fae05751a6041c48ef1d88301ada7f0/users/ad32647c40854a77af7f1770f96653b7/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:55.550215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5027e-28b1-4a17-8e17-3b7f47914a5d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.614445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5027e-28b1-4a17-8e17-3b7f47914a5d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.619157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac52b-77b7-4fda-bb5b-2b240ed8994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.619759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac52b-77b7-4fda-bb5b-2b240ed8994f admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.620050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac52b-77b7-4fda-bb5b-2b240ed8994f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.620324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac52b-77b7-4fda-bb5b-2b240ed8994f admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.621050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dac52b-77b7-4fda-bb5b-2b240ed8994f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.623214 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dac52b-77b7-4fda-bb5b-2b240ed8994f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.635171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 799/1600] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.640059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac52b-77b7-4fda-bb5b-2b240ed8994f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.641264 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 802/1601] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:55 2022] PUT /identity/v3/projects/2aa36ad3985147bea21fb375453ab8cf/users/1616dff84f03410f9b8a1c1c3b853b90/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:55.642153 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046fc1-76b2-4d57-9bc8-992491494d11 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.651087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac52b-77b7-4fda-bb5b-2b240ed8994f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.660714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:55.702453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:55.723200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046fc1-76b2-4d57-9bc8-992491494d11 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.725848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371db5-69c0-4df2-a609-a75560110524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.726857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371db5-69c0-4df2-a609-a75560110524 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.727416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371db5-69c0-4df2-a609-a75560110524 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.727817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371db5-69c0-4df2-a609-a75560110524 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.728684 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371db5-69c0-4df2-a609-a75560110524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.729434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dbb04-78d6-48e4-a53e-acc96593b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.730361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371db5-69c0-4df2-a609-a75560110524 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.731698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dbb04-78d6-48e4-a53e-acc96593b088 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.732347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dbb04-78d6-48e4-a53e-acc96593b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.732976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dbb04-78d6-48e4-a53e-acc96593b088 admin admin] PATH_INFO: `/v3/projects/c03e1c24ea1e4f44abe145fe2ac807db/users/968c2a27cf3e422ebd26043126f23832/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.741905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 800/1602] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:55.742723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371db5-69c0-4df2-a609-a75560110524 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.752889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dbb04-78d6-48e4-a53e-acc96593b088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03e1c24ea1e4f44abe145fe2ac807db, user_id=968c2a27cf3e422ebd26043126f23832, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.754024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371db5-69c0-4df2-a609-a75560110524 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.756854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dbb04-78d6-48e4-a53e-acc96593b088 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.759879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe205167-5b37-4a2a-be34-2c470a99df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.760774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe205167-5b37-4a2a-be34-2c470a99df7a admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.761055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe205167-5b37-4a2a-be34-2c470a99df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.761581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe205167-5b37-4a2a-be34-2c470a99df7a admin admin] PATH_INFO: `/v3/projects/66d87b8e7af54b9dbb089b8a54716a7c/users/9158887f572545039af31a513c2bc0f1/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.780049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe205167-5b37-4a2a-be34-2c470a99df7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d87b8e7af54b9dbb089b8a54716a7c, user_id=9158887f572545039af31a513c2bc0f1, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.782779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe205167-5b37-4a2a-be34-2c470a99df7a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:55.829520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 803/1603] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:55 2022] PUT /identity/v3/projects/c03e1c24ea1e4f44abe145fe2ac807db/users/968c2a27cf3e422ebd26043126f23832/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:55.830273 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dbb04-78d6-48e4-a53e-acc96593b088 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:55.831859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-222dbb04-78d6-48e4-a53e-acc96593b088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:55.887984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dbb04-78d6-48e4-a53e-acc96593b088 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:55.891630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfa252-7bc2-4be8-a294-86ef9354adbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:55.892314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfa252-7bc2-4be8-a294-86ef9354adbe service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.892587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfa252-7bc2-4be8-a294-86ef9354adbe service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.892864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfa252-7bc2-4be8-a294-86ef9354adbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.920257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 801/1604] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:55 2022] PUT /identity/v3/projects/66d87b8e7af54b9dbb089b8a54716a7c/users/9158887f572545039af31a513c2bc0f1/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:55.922218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0731ae-abf8-481c-a573-ac9354260487 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:55.922509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0731ae-abf8-481c-a573-ac9354260487 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:55.922842 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0731ae-abf8-481c-a573-ac9354260487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:55.965367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-cd0731ae-abf8-481c-a573-ac9354260487 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:55.965367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cd0731ae-abf8-481c-a573-ac9354260487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:55.992371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfa252-7bc2-4be8-a294-86ef9354adbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:55.993961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfa252-7bc2-4be8-a294-86ef9354adbe service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:56.006829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 804/1605] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:56.008075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfa252-7bc2-4be8-a294-86ef9354adbe service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:56.019572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfa252-7bc2-4be8-a294-86ef9354adbe service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:56.056097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 802/1606] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:56.057595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc1eaa-60e7-444f-981b-17ba14c56e58 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.057895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc1eaa-60e7-444f-981b-17ba14c56e58 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.058344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc1eaa-60e7-444f-981b-17ba14c56e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.085760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5ddc1eaa-60e7-444f-981b-17ba14c56e58 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:56.087002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5ddc1eaa-60e7-444f-981b-17ba14c56e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:56.096418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e9bd3-64cb-4280-9548-04f8a667810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:56.097111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e9bd3-64cb-4280-9548-04f8a667810b admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.097635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e9bd3-64cb-4280-9548-04f8a667810b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.097907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e9bd3-64cb-4280-9548-04f8a667810b admin admin] PATH_INFO: `/v3/projects/c826d9677b32460e9b75efb935a42dfe/users/bf7dcc499f514883a40a85ca98c98ec9/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.104253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 803/1607] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:56.105220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc1eaa-60e7-444f-981b-17ba14c56e58 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:56.117260 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e9bd3-64cb-4280-9548-04f8a667810b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c826d9677b32460e9b75efb935a42dfe, user_id=bf7dcc499f514883a40a85ca98c98ec9, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:56.120100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e9bd3-64cb-4280-9548-04f8a667810b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:56.124586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc1eaa-60e7-444f-981b-17ba14c56e58 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:56.131528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25e01f-103a-447b-91e0-e9e0c75c908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:56.132673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e01f-103a-447b-91e0-e9e0c75c908c admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.133025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e01f-103a-447b-91e0-e9e0c75c908c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.133368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e01f-103a-447b-91e0-e9e0c75c908c admin admin] PATH_INFO: `/v3/projects/bbe8b4f41eea4b3785e9c74ef8613523/users/971d66fc7bd14dd2b2cc1d639639052a/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.150200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25e01f-103a-447b-91e0-e9e0c75c908c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe8b4f41eea4b3785e9c74ef8613523, user_id=971d66fc7bd14dd2b2cc1d639639052a, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:56.158089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25e01f-103a-447b-91e0-e9e0c75c908c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:56.310890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:56.310890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 805/1608] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:56 2022] PUT /identity/v3/projects/c826d9677b32460e9b75efb935a42dfe/users/bf7dcc499f514883a40a85ca98c98ec9/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:56.310890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3add-0f59-4a4a-a952-4cd5c9cb828e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.310890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3add-0f59-4a4a-a952-4cd5c9cb828e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.310890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3add-0f59-4a4a-a952-4cd5c9cb828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.310890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-93bc3add-0f59-4a4a-a952-4cd5c9cb828e None None] MFA Rules not processed for user `968c2a27cf3e422ebd26043126f23832`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:56.313027 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-93bc3add-0f59-4a4a-a952-4cd5c9cb828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:56.327782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 804/1609] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:56 2022] PUT /identity/v3/projects/bbe8b4f41eea4b3785e9c74ef8613523/users/971d66fc7bd14dd2b2cc1d639639052a/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:56.329942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028cfa-5f05-4612-9f8a-1f295dc3479f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.329942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028cfa-5f05-4612-9f8a-1f295dc3479f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.330423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028cfa-5f05-4612-9f8a-1f295dc3479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.350149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 806/1610] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:56.350735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-52028cfa-5f05-4612-9f8a-1f295dc3479f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:56.351013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3add-0f59-4a4a-a952-4cd5c9cb828e None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:56.352242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-52028cfa-5f05-4612-9f8a-1f295dc3479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:56.418949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:56.440470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3add-0f59-4a4a-a952-4cd5c9cb828e None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:56.455545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 805/1611] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:56.455545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028cfa-5f05-4612-9f8a-1f295dc3479f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:56.532940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028cfa-5f05-4612-9f8a-1f295dc3479f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:56.544607 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c759fe-5bc8-4495-98d6-d35469ced14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:56.544753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c759fe-5bc8-4495-98d6-d35469ced14e service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.544946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c759fe-5bc8-4495-98d6-d35469ced14e service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.545659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb53e0-245f-428e-81cc-51b0f32f2e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:56.546831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb53e0-245f-428e-81cc-51b0f32f2e73 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.547116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb53e0-245f-428e-81cc-51b0f32f2e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.547514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb53e0-245f-428e-81cc-51b0f32f2e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.548834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c759fe-5bc8-4495-98d6-d35469ced14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.566227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c759fe-5bc8-4495-98d6-d35469ced14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:56.566576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb53e0-245f-428e-81cc-51b0f32f2e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:56.567590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c759fe-5bc8-4495-98d6-d35469ced14e service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:56.568512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb53e0-245f-428e-81cc-51b0f32f2e73 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:56.582735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 807/1612] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:56.583245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 806/1613] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:56.584476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e3192-c1ee-4aa9-b1c6-929118fe686f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.584693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d311bc-4cbe-4799-a175-fdba2bf77a56 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.584821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e3192-c1ee-4aa9-b1c6-929118fe686f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.585034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e3192-c1ee-4aa9-b1c6-929118fe686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.585299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d311bc-4cbe-4799-a175-fdba2bf77a56 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.585679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d311bc-4cbe-4799-a175-fdba2bf77a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.618919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-73d311bc-4cbe-4799-a175-fdba2bf77a56 None None] MFA Rules not processed for user `bf7dcc499f514883a40a85ca98c98ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:56.620203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-73d311bc-4cbe-4799-a175-fdba2bf77a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:56.627379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-473e3192-c1ee-4aa9-b1c6-929118fe686f None None] MFA Rules not processed for user `971d66fc7bd14dd2b2cc1d639639052a`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:56.628724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-473e3192-c1ee-4aa9-b1c6-929118fe686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:56.670211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:56.700103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 808/1614] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:56.700960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d311bc-4cbe-4799-a175-fdba2bf77a56 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:56.705527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 807/1615] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:56.707650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e3192-c1ee-4aa9-b1c6-929118fe686f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:56.723098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e3192-c1ee-4aa9-b1c6-929118fe686f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:56.727489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8c5ea-919c-4373-864e-e64c1f76a351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:56.728194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c5ea-919c-4373-864e-e64c1f76a351 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.728574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c5ea-919c-4373-864e-e64c1f76a351 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.729221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c5ea-919c-4373-864e-e64c1f76a351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.735367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d311bc-4cbe-4799-a175-fdba2bf77a56 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:56.743608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8c5ea-919c-4373-864e-e64c1f76a351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:56.745674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8c5ea-919c-4373-864e-e64c1f76a351 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:56.750536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add3421-ff43-4279-b470-c8e2b403c52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:56.751219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add3421-ff43-4279-b470-c8e2b403c52e admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.751506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add3421-ff43-4279-b470-c8e2b403c52e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.751803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add3421-ff43-4279-b470-c8e2b403c52e admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.752507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add3421-ff43-4279-b470-c8e2b403c52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:56.754583 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add3421-ff43-4279-b470-c8e2b403c52e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:56.766069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 808/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:56.766460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8c5ea-919c-4373-864e-e64c1f76a351 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:56.778819 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8c5ea-919c-4373-864e-e64c1f76a351 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:56.787875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8a7b0-2800-4add-bc7f-efbcbe403879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:56.789718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a7b0-2800-4add-bc7f-efbcbe403879 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:56.792147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a7b0-2800-4add-bc7f-efbcbe403879 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:56.792147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a7b0-2800-4add-bc7f-efbcbe403879 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:56.792147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8a7b0-2800-4add-bc7f-efbcbe403879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:56.799114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8a7b0-2800-4add-bc7f-efbcbe403879 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:56.881481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 809/1617] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:56 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:56.881481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add3421-ff43-4279-b470-c8e2b403c52e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:56.939372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 809/1618] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:39:56 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:56.940824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8a7b0-2800-4add-bc7f-efbcbe403879 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.015659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add3421-ff43-4279-b470-c8e2b403c52e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.033324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:57.062480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8a7b0-2800-4add-bc7f-efbcbe403879 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.073320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe96e7c-4a28-4424-a7ec-a031ed8f239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.074405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe96e7c-4a28-4424-a7ec-a031ed8f239b admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.074946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe96e7c-4a28-4424-a7ec-a031ed8f239b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.076232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe96e7c-4a28-4424-a7ec-a031ed8f239b admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.077405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe96e7c-4a28-4424-a7ec-a031ed8f239b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.082821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe96e7c-4a28-4424-a7ec-a031ed8f239b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.111311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005d3bd-76c2-4024-8e17-79238cdbf94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.111674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005d3bd-76c2-4024-8e17-79238cdbf94f service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.112119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005d3bd-76c2-4024-8e17-79238cdbf94f service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.112686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005d3bd-76c2-4024-8e17-79238cdbf94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.225294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005d3bd-76c2-4024-8e17-79238cdbf94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.227471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005d3bd-76c2-4024-8e17-79238cdbf94f service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.263836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 810/1619] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:56 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:57.263836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe96e7c-4a28-4424-a7ec-a031ed8f239b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.264161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 810/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:57.265753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005d3bd-76c2-4024-8e17-79238cdbf94f service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.270912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe96e7c-4a28-4424-a7ec-a031ed8f239b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.282706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005d3bd-76c2-4024-8e17-79238cdbf94f service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.283246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709b5aa-8ba2-405b-9ef4-27f7d453508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.283968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709b5aa-8ba2-405b-9ef4-27f7d453508d admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.284255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709b5aa-8ba2-405b-9ef4-27f7d453508d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.284537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709b5aa-8ba2-405b-9ef4-27f7d453508d admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.285380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709b5aa-8ba2-405b-9ef4-27f7d453508d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.287359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709b5aa-8ba2-405b-9ef4-27f7d453508d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.293554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0c041-347a-4852-b7d3-9cd8e6334e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.294649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0c041-347a-4852-b7d3-9cd8e6334e76 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.295148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0c041-347a-4852-b7d3-9cd8e6334e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.295640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0c041-347a-4852-b7d3-9cd8e6334e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.296874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0c041-347a-4852-b7d3-9cd8e6334e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.299865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0c041-347a-4852-b7d3-9cd8e6334e76 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.329450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 811/1621] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:57.333386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0c041-347a-4852-b7d3-9cd8e6334e76 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.352393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0c041-347a-4852-b7d3-9cd8e6334e76 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.363780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef5fe6-e9e4-4769-b5e6-c06c36e7e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.365324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5fe6-e9e4-4769-b5e6-c06c36e7e926 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.365653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5fe6-e9e4-4769-b5e6-c06c36e7e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.366077 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5fe6-e9e4-4769-b5e6-c06c36e7e926 admin admin] PATH_INFO: `/v3/projects/7a065ad652fe4c91ac7e33d511cfe5b4/users/80591028f0504faa9545249966c27fe1/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.405197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 811/1622] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:39:57 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:39:57.406851 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709b5aa-8ba2-405b-9ef4-27f7d453508d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.416733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:57.428042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef5fe6-e9e4-4769-b5e6-c06c36e7e926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a065ad652fe4c91ac7e33d511cfe5b4, user_id=80591028f0504faa9545249966c27fe1, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.436364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef5fe6-e9e4-4769-b5e6-c06c36e7e926 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.439165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709b5aa-8ba2-405b-9ef4-27f7d453508d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.457011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a433c9-733d-446e-80d3-fa13b00f6e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.457011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a433c9-733d-446e-80d3-fa13b00f6e47 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.457011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a433c9-733d-446e-80d3-fa13b00f6e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.457011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a433c9-733d-446e-80d3-fa13b00f6e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.457411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a433c9-733d-446e-80d3-fa13b00f6e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.462882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a433c9-733d-446e-80d3-fa13b00f6e47 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.480512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 812/1623] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:39:57.484327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a433c9-733d-446e-80d3-fa13b00f6e47 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.498781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a433c9-733d-446e-80d3-fa13b00f6e47 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.505527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f0479-f220-454c-8bfd-33b44654000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.507904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f0479-f220-454c-8bfd-33b44654000a admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.508294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f0479-f220-454c-8bfd-33b44654000a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.508779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f0479-f220-454c-8bfd-33b44654000a admin admin] PATH_INFO: `/v3/projects/79ba45fb353a42cea43bf243fdafe4c8/users/720cedd0a57e4e92a1e4aa690af9fc07/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.540347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f0479-f220-454c-8bfd-33b44654000a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ba45fb353a42cea43bf243fdafe4c8, user_id=720cedd0a57e4e92a1e4aa690af9fc07, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.543724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f0479-f220-454c-8bfd-33b44654000a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.583750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 812/1624] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:57 2022] PUT /identity/v3/projects/7a065ad652fe4c91ac7e33d511cfe5b4/users/80591028f0504faa9545249966c27fe1/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:57.586153 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef5fe6-e9e4-4769-b5e6-c06c36e7e926 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.665488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 813/1625] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:57 2022] PUT /identity/v3/projects/79ba45fb353a42cea43bf243fdafe4c8/users/720cedd0a57e4e92a1e4aa690af9fc07/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:39:57.666943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f0479-f220-454c-8bfd-33b44654000a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.719301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef5fe6-e9e4-4769-b5e6-c06c36e7e926 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.839584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f0479-f220-454c-8bfd-33b44654000a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.845717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c9b34-0b6f-41cb-9d7b-a5021ad76692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.847377 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c9b34-0b6f-41cb-9d7b-a5021ad76692 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.847515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6d61-b922-4c2d-9c7c-58e6b88d07ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.848042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c9b34-0b6f-41cb-9d7b-a5021ad76692 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.848161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6d61-b922-4c2d-9c7c-58e6b88d07ce admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.848161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6d61-b922-4c2d-9c7c-58e6b88d07ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.848325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c9b34-0b6f-41cb-9d7b-a5021ad76692 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.848400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6d61-b922-4c2d-9c7c-58e6b88d07ce admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.849019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c9b34-0b6f-41cb-9d7b-a5021ad76692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.849140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a6d61-b922-4c2d-9c7c-58e6b88d07ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.850802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c9b34-0b6f-41cb-9d7b-a5021ad76692 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.850923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a6d61-b922-4c2d-9c7c-58e6b88d07ce admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.877664 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 814/1626] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:39:57.877664 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c9b34-0b6f-41cb-9d7b-a5021ad76692 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.887184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 813/1627] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:39:57.888304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6d61-b922-4c2d-9c7c-58e6b88d07ce admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:57.916439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6d61-b922-4c2d-9c7c-58e6b88d07ce admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.926973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c9b34-0b6f-41cb-9d7b-a5021ad76692 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:57.937352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f265d8a-1beb-4fcf-b3bd-cb008870ecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.939421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f265d8a-1beb-4fcf-b3bd-cb008870ecba admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.939763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f265d8a-1beb-4fcf-b3bd-cb008870ecba admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.945784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdda7d-1f42-40e9-a095-673f58dce992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:57.947086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f265d8a-1beb-4fcf-b3bd-cb008870ecba admin admin] PATH_INFO: `/v3/projects/79ba45fb353a42cea43bf243fdafe4c8/users/720cedd0a57e4e92a1e4aa690af9fc07/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.959515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f265d8a-1beb-4fcf-b3bd-cb008870ecba admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ba45fb353a42cea43bf243fdafe4c8, user_id=720cedd0a57e4e92a1e4aa690af9fc07, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.962355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f265d8a-1beb-4fcf-b3bd-cb008870ecba admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.968970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdda7d-1f42-40e9-a095-673f58dce992 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:57.969713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdda7d-1f42-40e9-a095-673f58dce992 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:57.970734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdda7d-1f42-40e9-a095-673f58dce992 admin admin] PATH_INFO: `/v3/projects/7a065ad652fe4c91ac7e33d511cfe5b4/users/80591028f0504faa9545249966c27fe1/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:57.977354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdda7d-1f42-40e9-a095-673f58dce992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a065ad652fe4c91ac7e33d511cfe5b4, user_id=80591028f0504faa9545249966c27fe1, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:57.986771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdda7d-1f42-40e9-a095-673f58dce992 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:57.990686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 815/1628] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:57 2022] PUT /identity/v3/projects/79ba45fb353a42cea43bf243fdafe4c8/users/720cedd0a57e4e92a1e4aa690af9fc07/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:58.007593 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ac99f-c6a4-40bc-8782-1e61f108e723 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:58.007945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ac99f-c6a4-40bc-8782-1e61f108e723 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:58.008220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ac99f-c6a4-40bc-8782-1e61f108e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:58.040262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 814/1629] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:39:57 2022] PUT /identity/v3/projects/7a065ad652fe4c91ac7e33d511cfe5b4/users/80591028f0504faa9545249966c27fe1/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:58.054135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51814-9001-48c6-8318-28f7f84baaeb None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:58.056119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51814-9001-48c6-8318-28f7f84baaeb None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:58.056629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51814-9001-48c6-8318-28f7f84baaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:58.110328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-bc3ac99f-c6a4-40bc-8782-1e61f108e723 None None] MFA Rules not processed for user `720cedd0a57e4e92a1e4aa690af9fc07`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:58.111963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-bc3ac99f-c6a4-40bc-8782-1e61f108e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:58.162092 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-73d51814-9001-48c6-8318-28f7f84baaeb None None] MFA Rules not processed for user `80591028f0504faa9545249966c27fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:58.163486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-73d51814-9001-48c6-8318-28f7f84baaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:58.285502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:58.300399 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 816/1630] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:58.313836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ac99f-c6a4-40bc-8782-1e61f108e723 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:58.352096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 815/1631] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:39:58.398896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ac99f-c6a4-40bc-8782-1e61f108e723 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:58.411304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc6d7-a778-4284-a906-73f151cbdfc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:58.412169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc6d7-a778-4284-a906-73f151cbdfc7 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:58.412599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc6d7-a778-4284-a906-73f151cbdfc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:58.412975 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc6d7-a778-4284-a906-73f151cbdfc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:58.426707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dc6d7-a778-4284-a906-73f151cbdfc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:58.438201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dc6d7-a778-4284-a906-73f151cbdfc7 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:58.462066 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 817/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:39:58.623419 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51814-9001-48c6-8318-28f7f84baaeb None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:58.644872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51814-9001-48c6-8318-28f7f84baaeb None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:58.660282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae5295-e46b-4cc8-bbfe-96ca5439ab8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:58.660961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae5295-e46b-4cc8-bbfe-96ca5439ab8d service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:58.661250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae5295-e46b-4cc8-bbfe-96ca5439ab8d service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:58.661532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae5295-e46b-4cc8-bbfe-96ca5439ab8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:58.673995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:58.681355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae5295-e46b-4cc8-bbfe-96ca5439ab8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:58.682827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae5295-e46b-4cc8-bbfe-96ca5439ab8d service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:58.705892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 816/1633] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:59.148455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc6d7-a778-4284-a906-73f151cbdfc7 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:59.167940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc6d7-a778-4284-a906-73f151cbdfc7 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:59.189845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fc5cf-9213-45e6-a38e-ecadcc4b908b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:59.191426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fc5cf-9213-45e6-a38e-ecadcc4b908b service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:59.192089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fc5cf-9213-45e6-a38e-ecadcc4b908b service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:59.192554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fc5cf-9213-45e6-a38e-ecadcc4b908b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:59.208684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae5295-e46b-4cc8-bbfe-96ca5439ab8d service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:59.221722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae5295-e46b-4cc8-bbfe-96ca5439ab8d service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:59.238828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fdc56-5b84-4c57-8cea-48d05cd1936d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:59.239692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fdc56-5b84-4c57-8cea-48d05cd1936d service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:59.243884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fdc56-5b84-4c57-8cea-48d05cd1936d service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:59.243884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fdc56-5b84-4c57-8cea-48d05cd1936d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:59.294465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fc5cf-9213-45e6-a38e-ecadcc4b908b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:59.297850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fc5cf-9213-45e6-a38e-ecadcc4b908b service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:59.311640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 818/1634] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:59.406732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fdc56-5b84-4c57-8cea-48d05cd1936d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:59.414078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fdc56-5b84-4c57-8cea-48d05cd1936d service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:59.440559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 817/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:39:59.996238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557e5a-1f76-4489-b81b-d20a2665eda1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:59.996529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557e5a-1f76-4489-b81b-d20a2665eda1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:59.996817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557e5a-1f76-4489-b81b-d20a2665eda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:00.058327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-66557e5a-1f76-4489-b81b-d20a2665eda1 None None] MFA Rules not processed for user `ad32647c40854a77af7f1770f96653b7`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:00.059853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-66557e5a-1f76-4489-b81b-d20a2665eda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:00.177266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 819/1636] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:39:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:00.181496 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fdc56-5b84-4c57-8cea-48d05cd1936d service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:00.303113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fdc56-5b84-4c57-8cea-48d05cd1936d service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:00.317507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc87f4-24a3-4cce-a668-61adfa39b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:00.318366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc87f4-24a3-4cce-a668-61adfa39b347 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:00.318959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc87f4-24a3-4cce-a668-61adfa39b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:00.319539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc87f4-24a3-4cce-a668-61adfa39b347 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:00.321538 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc87f4-24a3-4cce-a668-61adfa39b347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:00.324057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc87f4-24a3-4cce-a668-61adfa39b347 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:00.484071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 818/1637] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:00 2022] POST /identity/v3/projects => generated 403 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:00.486966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66557e5a-1f76-4489-b81b-d20a2665eda1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:00.501293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66557e5a-1f76-4489-b81b-d20a2665eda1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:00.576710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:00.617806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345afff-a03b-41d6-a62e-969068f0b6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:00.618503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345afff-a03b-41d6-a62e-969068f0b6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:00.618787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345afff-a03b-41d6-a62e-969068f0b6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:00.619065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345afff-a03b-41d6-a62e-969068f0b6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:00.619773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345afff-a03b-41d6-a62e-969068f0b6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:00.623261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345afff-a03b-41d6-a62e-969068f0b6b2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:00.941912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 820/1638] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:00 2022] POST /identity/v3/users => generated 308 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:00.944975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc87f4-24a3-4cce-a668-61adfa39b347 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:00.961771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc87f4-24a3-4cce-a668-61adfa39b347 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:00.985614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d577-69dc-477e-ab2f-d60d9770e7ef None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:00.985933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d577-69dc-477e-ab2f-d60d9770e7ef None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:00.986182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d577-69dc-477e-ab2f-d60d9770e7ef None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:00.987587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 821/1639] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jun 16 00:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:40:00.994341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e7c79-0d1e-45ae-8010-5c4af92baa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:00.994341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e7c79-0d1e-45ae-8010-5c4af92baa38 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:00.996953 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e7c79-0d1e-45ae-8010-5c4af92baa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:00.997307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e7c79-0d1e-45ae-8010-5c4af92baa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:00.997488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0683d-8470-40e6-ada3-d3198396dd2c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:00.997761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0683d-8470-40e6-ada3-d3198396dd2c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:00.998041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0683d-8470-40e6-ada3-d3198396dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:00.998145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e7c79-0d1e-45ae-8010-5c4af92baa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:01.004919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e7c79-0d1e-45ae-8010-5c4af92baa38 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:01.031975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 819/1640] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:01.042122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e7c79-0d1e-45ae-8010-5c4af92baa38 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:01.055936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-dbc0683d-8470-40e6-ada3-d3198396dd2c None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:01.062158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dbc0683d-8470-40e6-ada3-d3198396dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:01.065248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e7c79-0d1e-45ae-8010-5c4af92baa38 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:01.080022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684256b-2ed4-4352-9deb-f2af2c86e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:01.081062 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684256b-2ed4-4352-9deb-f2af2c86e5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:01.081462 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684256b-2ed4-4352-9deb-f2af2c86e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:01.081853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684256b-2ed4-4352-9deb-f2af2c86e5c6 admin admin] PATH_INFO: `/v3/projects/6df6e6ef677a47498793d478c435bf6a/users/7c6df22a29b94e759398d12c8d4bdc8d/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:01.121538 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684256b-2ed4-4352-9deb-f2af2c86e5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df6e6ef677a47498793d478c435bf6a, user_id=7c6df22a29b94e759398d12c8d4bdc8d, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:01.125827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684256b-2ed4-4352-9deb-f2af2c86e5c6 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:01.240295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 822/1641] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jun 16 00:40:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:01.248936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057d8e5-d19a-4d10-bd66-e0b76f0a43b3 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:01.249371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057d8e5-d19a-4d10-bd66-e0b76f0a43b3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:01.249936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057d8e5-d19a-4d10-bd66-e0b76f0a43b3 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:01.253116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 823/1642] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jun 16 00:40:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:01.259071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23785356-7fe0-4c45-be01-c67d46309f88 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:01.259454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23785356-7fe0-4c45-be01-c67d46309f88 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:01.259904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23785356-7fe0-4c45-be01-c67d46309f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:01.265798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 820/1643] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:01 2022] PUT /identity/v3/projects/6df6e6ef677a47498793d478c435bf6a/users/7c6df22a29b94e759398d12c8d4bdc8d/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:01.266751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684256b-2ed4-4352-9deb-f2af2c86e5c6 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:01.314635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-23785356-7fe0-4c45-be01-c67d46309f88 None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:01.316567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-23785356-7fe0-4c45-be01-c67d46309f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:01.402672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:01.432836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 824/1644] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:40:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:01.436604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684256b-2ed4-4352-9deb-f2af2c86e5c6 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:01.446588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23785356-7fe0-4c45-be01-c67d46309f88 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:01.459367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a54a4-cf60-49b7-a8a3-43f0b68f65ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:01.460179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a54a4-cf60-49b7-a8a3-43f0b68f65ac admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:01.460459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a54a4-cf60-49b7-a8a3-43f0b68f65ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:01.460735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a54a4-cf60-49b7-a8a3-43f0b68f65ac admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:01.461470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a54a4-cf60-49b7-a8a3-43f0b68f65ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:01.463118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a54a4-cf60-49b7-a8a3-43f0b68f65ac admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:01.483341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 821/1645] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:01.484271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a54a4-cf60-49b7-a8a3-43f0b68f65ac admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:01.517518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a54a4-cf60-49b7-a8a3-43f0b68f65ac admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:01.525412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e3bc-2844-41e4-85d8-ac3ca72697c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:01.526320 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e3bc-2844-41e4-85d8-ac3ca72697c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:01.526794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e3bc-2844-41e4-85d8-ac3ca72697c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:01.527085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e3bc-2844-41e4-85d8-ac3ca72697c9 admin admin] PATH_INFO: `/v3/projects/6df6e6ef677a47498793d478c435bf6a/users/7c6df22a29b94e759398d12c8d4bdc8d/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:01.542122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e3bc-2844-41e4-85d8-ac3ca72697c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df6e6ef677a47498793d478c435bf6a, user_id=7c6df22a29b94e759398d12c8d4bdc8d, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:01.544868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e3bc-2844-41e4-85d8-ac3ca72697c9 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:01.572140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 822/1646] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:01 2022] PUT /identity/v3/projects/6df6e6ef677a47498793d478c435bf6a/users/7c6df22a29b94e759398d12c8d4bdc8d/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:01.588789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23785356-7fe0-4c45-be01-c67d46309f88 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:01.740766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8150293-fc04-4657-925e-e97ff667e051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:01.742040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150293-fc04-4657-925e-e97ff667e051 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:01.742146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150293-fc04-4657-925e-e97ff667e051 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:01.742474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150293-fc04-4657-925e-e97ff667e051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:01.902960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8150293-fc04-4657-925e-e97ff667e051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:01.904584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8150293-fc04-4657-925e-e97ff667e051 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:01.945421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 825/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:40:01.961557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:04.853859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4486-aa29-4873-b1fe-8fea70f42c2e None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:04.854752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4486-aa29-4873-b1fe-8fea70f42c2e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:04.855183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4486-aa29-4873-b1fe-8fea70f42c2e None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:04.857265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 823/1648] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jun 16 00:40:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:04.884155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4067bb4-0ba1-489d-9c5d-84c9b4912984 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:04.884750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4067bb4-0ba1-489d-9c5d-84c9b4912984 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:04.885820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4067bb4-0ba1-489d-9c5d-84c9b4912984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:04.933980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d4067bb4-0ba1-489d-9c5d-84c9b4912984 None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:04.935137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d4067bb4-0ba1-489d-9c5d-84c9b4912984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:04.959223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 826/1649] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jun 16 00:40:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:04.966646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30749fa-71c3-4904-9c5f-ec32f10b47ca None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:04.967058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30749fa-71c3-4904-9c5f-ec32f10b47ca None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:04.967468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30749fa-71c3-4904-9c5f-ec32f10b47ca None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:04.973662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 824/1650] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jun 16 00:40:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:04.975863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c9f4b-e7d3-4d62-a214-827ed1567f1f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:04.976245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c9f4b-e7d3-4d62-a214-827ed1567f1f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:04.976652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c9f4b-e7d3-4d62-a214-827ed1567f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:05.023837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-018c9f4b-e7d3-4d62-a214-827ed1567f1f None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:05.025495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-018c9f4b-e7d3-4d62-a214-827ed1567f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:05.056835 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364c628-3fcc-4cdf-b2e8-d2bcb9f185ff None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:05.057341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364c628-3fcc-4cdf-b2e8-d2bcb9f185ff None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:05.057853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364c628-3fcc-4cdf-b2e8-d2bcb9f185ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:05.071699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 827/1651] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:40:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:05.091060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c9f4b-e7d3-4d62-a214-827ed1567f1f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:05.099952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c9f4b-e7d3-4d62-a214-827ed1567f1f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:05.138606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f24f1-8244-456b-9166-969e5696c3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:05.138606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f24f1-8244-456b-9166-969e5696c3eb service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:05.138606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f24f1-8244-456b-9166-969e5696c3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:05.138606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f24f1-8244-456b-9166-969e5696c3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:05.144401 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c364c628-3fcc-4cdf-b2e8-d2bcb9f185ff None None] MFA Rules not processed for user `eb6d9398095c426f9d39eef485c45c66`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:05.151381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c364c628-3fcc-4cdf-b2e8-d2bcb9f185ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:05.154915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f24f1-8244-456b-9166-969e5696c3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:05.157552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f24f1-8244-456b-9166-969e5696c3eb service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:05.180385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 828/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:40:05.188333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee295c4-a6d1-47a3-98cd-b10c5883e1fc None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:05.193625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee295c4-a6d1-47a3-98cd-b10c5883e1fc None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:05.193909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee295c4-a6d1-47a3-98cd-b10c5883e1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:05.255676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-bee295c4-a6d1-47a3-98cd-b10c5883e1fc None None] MFA Rules not processed for user `7c6df22a29b94e759398d12c8d4bdc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:05.257441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-bee295c4-a6d1-47a3-98cd-b10c5883e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:05.346547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 825/1653] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:05.371604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364c628-3fcc-4cdf-b2e8-d2bcb9f185ff None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:05.403218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364c628-3fcc-4cdf-b2e8-d2bcb9f185ff None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:05.428581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f18b2a-92c7-4e6a-a42b-8ef16ec0495a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:05.429328 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f18b2a-92c7-4e6a-a42b-8ef16ec0495a service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:05.429681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f18b2a-92c7-4e6a-a42b-8ef16ec0495a service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:05.430033 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f18b2a-92c7-4e6a-a42b-8ef16ec0495a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:05.442840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:05.458442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f18b2a-92c7-4e6a-a42b-8ef16ec0495a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:05.460381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f18b2a-92c7-4e6a-a42b-8ef16ec0495a service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:05.483065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 829/1654] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:05.498955 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 826/1655] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:40:07.573159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b9feb-2b88-461c-894e-61f32e8c07a7 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:07.573631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b9feb-2b88-461c-894e-61f32e8c07a7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:07.575635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b9feb-2b88-461c-894e-61f32e8c07a7 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:07.576155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 830/1656] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:07.618748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dc07a-566e-4690-8eae-6b0667bf5655 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:07.619239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dc07a-566e-4690-8eae-6b0667bf5655 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:07.619335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dc07a-566e-4690-8eae-6b0667bf5655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:07.678370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ca0dc07a-566e-4690-8eae-6b0667bf5655 None None] MFA Rules not processed for user `b2e57a7647d143f5835225616138827e`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:07.682127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ca0dc07a-566e-4690-8eae-6b0667bf5655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:07.840714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 827/1657] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:07.986158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b45f89-38d7-4566-a817-b7286040036b None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:07.987014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b45f89-38d7-4566-a817-b7286040036b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:07.987520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b45f89-38d7-4566-a817-b7286040036b None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:07.989243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 831/1658] 10.222.0.27 () {54 vars in 960 bytes} [Thu Jun 16 00:40:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:08.011877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c79c41-3a5f-40de-83ee-a4edaa06bb15 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:08.011877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c79c41-3a5f-40de-83ee-a4edaa06bb15 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:08.011877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c79c41-3a5f-40de-83ee-a4edaa06bb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:08.053364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-28c79c41-3a5f-40de-83ee-a4edaa06bb15 None None] MFA Rules not processed for user `b2e57a7647d143f5835225616138827e`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:08.055318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-28c79c41-3a5f-40de-83ee-a4edaa06bb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:08.091059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b45f89-38d7-4566-a817-b7286040036b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:08.093963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 828/1659] 10.222.0.27 () {58 vars in 1057 bytes} [Thu Jun 16 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:08.138324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b45f89-38d7-4566-a817-b7286040036b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:08.149691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748c616-5764-40bd-a6aa-ad58ca8fc298 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:08.151644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748c616-5764-40bd-a6aa-ad58ca8fc298 service placement] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:08.152714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748c616-5764-40bd-a6aa-ad58ca8fc298 service placement] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:08.153847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748c616-5764-40bd-a6aa-ad58ca8fc298 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:08.172508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748c616-5764-40bd-a6aa-ad58ca8fc298 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:08.174628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748c616-5764-40bd-a6aa-ad58ca8fc298 service placement] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:08.226354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 832/1660] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:09.505936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c79c41-3a5f-40de-83ee-a4edaa06bb15 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:09.609287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:09.702120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c79c41-3a5f-40de-83ee-a4edaa06bb15 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:09.735118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:09.738486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:09.739221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:09.740373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] PATH_INFO: `/v3/users/ad32647c40854a77af7f1770f96653b7` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:09.744762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad32647c40854a77af7f1770f96653b7)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:09.748313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:10.122405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad32647c40854a77af7f1770f96653b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:10.132191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad32647c40854a77af7f1770f96653b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:10.267834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad32647c40854a77af7f1770f96653b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:10.276078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad32647c40854a77af7f1770f96653b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:10.338165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b777b2c7-23d0-46d7-afe2-b8bf2f55b2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad32647c40854a77af7f1770f96653b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:10.373235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 829/1661] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:09 2022] DELETE /identity/v3/users/ad32647c40854a77af7f1770f96653b7 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:11.185116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53bf2e-d944-482c-b298-484e78cbd364 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:11.185534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53bf2e-d944-482c-b298-484e78cbd364 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:11.185682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53bf2e-d944-482c-b298-484e78cbd364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:11.277771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ac53bf2e-d944-482c-b298-484e78cbd364 None None] MFA Rules not processed for user `0dd27b6f42d3412e94e582391a00474c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:11.278817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ac53bf2e-d944-482c-b298-484e78cbd364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:11.442847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 833/1662] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:11.456649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570f444-a66b-4a36-84ba-fbf2dc2ac16a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:11.457556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570f444-a66b-4a36-84ba-fbf2dc2ac16a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:11.458267 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570f444-a66b-4a36-84ba-fbf2dc2ac16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:11.509629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4570f444-a66b-4a36-84ba-fbf2dc2ac16a None None] MFA Rules not processed for user `0dd27b6f42d3412e94e582391a00474c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:11.515197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4570f444-a66b-4a36-84ba-fbf2dc2ac16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:11.522056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623981d3-c2f5-4f70-a4b5-a0b8762f9362 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:11.522535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623981d3-c2f5-4f70-a4b5-a0b8762f9362 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:11.522950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623981d3-c2f5-4f70-a4b5-a0b8762f9362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:11.534125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 830/1663] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:11.545418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570f444-a66b-4a36-84ba-fbf2dc2ac16a None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:11.551995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4570f444-a66b-4a36-84ba-fbf2dc2ac16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:11.585387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-623981d3-c2f5-4f70-a4b5-a0b8762f9362 None None] MFA Rules not processed for user `1616dff84f03410f9b8a1c1c3b853b90`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:11.589497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-623981d3-c2f5-4f70-a4b5-a0b8762f9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:11.814571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 834/1664] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:11.815954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623981d3-c2f5-4f70-a4b5-a0b8762f9362 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:11.818189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-623981d3-c2f5-4f70-a4b5-a0b8762f9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:11.832770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570f444-a66b-4a36-84ba-fbf2dc2ac16a None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:11.852764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2452887-78c7-4489-9d72-6ff98b152f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:11.853677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2452887-78c7-4489-9d72-6ff98b152f0e service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:11.855838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2452887-78c7-4489-9d72-6ff98b152f0e service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:11.856128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2452887-78c7-4489-9d72-6ff98b152f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:11.879832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2452887-78c7-4489-9d72-6ff98b152f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:11.881822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2452887-78c7-4489-9d72-6ff98b152f0e service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:11.922999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 831/1665] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:11.924618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776d550-80c3-47d4-820f-0b4e57742b87 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:11.925045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776d550-80c3-47d4-820f-0b4e57742b87 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:11.925338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776d550-80c3-47d4-820f-0b4e57742b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:11.971238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7776d550-80c3-47d4-820f-0b4e57742b87 None None] MFA Rules not processed for user `1616dff84f03410f9b8a1c1c3b853b90`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:11.975046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7776d550-80c3-47d4-820f-0b4e57742b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:12.005011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 832/1666] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:12.042307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776d550-80c3-47d4-820f-0b4e57742b87 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:12.045324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7776d550-80c3-47d4-820f-0b4e57742b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:12.068780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623981d3-c2f5-4f70-a4b5-a0b8762f9362 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:12.080383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776d550-80c3-47d4-820f-0b4e57742b87 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:12.089902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2db08-caec-4b33-ae00-3f40c25823bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:12.090782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2db08-caec-4b33-ae00-3f40c25823bd service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:12.091123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2db08-caec-4b33-ae00-3f40c25823bd service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:12.091556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2db08-caec-4b33-ae00-3f40c25823bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:12.098725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:12.102325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:12.104015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:12.107057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] PATH_INFO: `/v3/projects/9fae05751a6041c48ef1d88301ada7f0` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:12.110249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fae05751a6041c48ef1d88301ada7f0)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:12.116580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:12.123763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2db08-caec-4b33-ae00-3f40c25823bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:12.125664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2db08-caec-4b33-ae00-3f40c25823bd service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:12.126700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:12.149006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 833/1667] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:12.409020 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fae05751a6041c48ef1d88301ada7f0', 'request_id': 'req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:12.431287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fae05751a6041c48ef1d88301ada7f0', 'request_id': 'req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:12.443006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fae05751a6041c48ef1d88301ada7f0', 'request_id': 'req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:12.646340 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] The token cache is being invalidate because project 9fae05751a6041c48ef1d88301ada7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:12.646631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:12.647956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74c5af95-a270-4ed9-9a73-3e0a27c1ac91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:12.650067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 835/1668] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:11 2022] DELETE /identity/v3/projects/9fae05751a6041c48ef1d88301ada7f0 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:12.654385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2db08-caec-4b33-ae00-3f40c25823bd service nova] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:12.672683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2db08-caec-4b33-ae00-3f40c25823bd service nova] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:12.684226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:12.797992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:12.799210 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:12.799760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:12.800281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] PATH_INFO: `/v3/users/7c6df22a29b94e759398d12c8d4bdc8d` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:12.801751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6df22a29b94e759398d12c8d4bdc8d)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:12.804528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:12.990287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310ffae-5e69-487e-8737-0da7adbadb30 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:12.990772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310ffae-5e69-487e-8737-0da7adbadb30 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:12.991141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310ffae-5e69-487e-8737-0da7adbadb30 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:13.004630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 836/1669] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jun 16 00:40:12 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:13.011646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdd444-1644-4598-a535-7429f76fdc9d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:13.015324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdd444-1644-4598-a535-7429f76fdc9d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:13.015846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdd444-1644-4598-a535-7429f76fdc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:13.023489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6df22a29b94e759398d12c8d4bdc8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:13.026630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6df22a29b94e759398d12c8d4bdc8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:13.108846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e1cdd444-1644-4598-a535-7429f76fdc9d None None] MFA Rules not processed for user `20b4902b340a4260a0b5f716c3ae9acf`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:13.112778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e1cdd444-1644-4598-a535-7429f76fdc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:13.156048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6df22a29b94e759398d12c8d4bdc8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:13.194902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6df22a29b94e759398d12c8d4bdc8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:13.232715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6df22a29b94e759398d12c8d4bdc8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:13.244541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 837/1670] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:40:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:13.254633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 834/1671] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:12 2022] DELETE /identity/v3/users/7c6df22a29b94e759398d12c8d4bdc8d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:13.266152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765bb0f-c51a-499d-8f22-5ba390418821 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:13.266454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765bb0f-c51a-499d-8f22-5ba390418821 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:13.266738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765bb0f-c51a-499d-8f22-5ba390418821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:13.305672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:13.308681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:13.331364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-3765bb0f-c51a-499d-8f22-5ba390418821 None None] MFA Rules not processed for user `9158887f572545039af31a513c2bc0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:13.333074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3765bb0f-c51a-499d-8f22-5ba390418821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:13.439434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2ef9a-e4f8-4dcd-b0e0-2eb7453f0c87 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:13.450222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b01214-7c7f-460b-8eb0-3902e9e40517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:13.451039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b01214-7c7f-460b-8eb0-3902e9e40517 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:13.451981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b01214-7c7f-460b-8eb0-3902e9e40517 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:13.451981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b01214-7c7f-460b-8eb0-3902e9e40517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:13.456599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-05b01214-7c7f-460b-8eb0-3902e9e40517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:13.479371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b01214-7c7f-460b-8eb0-3902e9e40517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:13.483253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b01214-7c7f-460b-8eb0-3902e9e40517 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:13.503352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 835/1672] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:13.504910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9eb26-31d6-4902-b01a-02f7bbdaabb1 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:13.511798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9eb26-31d6-4902-b01a-02f7bbdaabb1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:13.512071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 838/1673] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:13.512483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9eb26-31d6-4902-b01a-02f7bbdaabb1 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:13.512483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 836/1674] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jun 16 00:40:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:13.539209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3668b-c448-4569-8044-d0299b2cff7f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:13.539209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3668b-c448-4569-8044-d0299b2cff7f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:13.539209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3668b-c448-4569-8044-d0299b2cff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:13.587275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a8d3668b-c448-4569-8044-d0299b2cff7f None None] MFA Rules not processed for user `20b4902b340a4260a0b5f716c3ae9acf`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:13.589114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a8d3668b-c448-4569-8044-d0299b2cff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:13.600637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 839/1675] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:40:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:13.617693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9eb26-31d6-4902-b01a-02f7bbdaabb1 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:13.619609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-15f9eb26-31d6-4902-b01a-02f7bbdaabb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:13.643465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9eb26-31d6-4902-b01a-02f7bbdaabb1 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:13.653039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cabcb-d1d0-4bb8-a704-762e21fa147c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:13.653719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cabcb-d1d0-4bb8-a704-762e21fa147c service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:13.654010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cabcb-d1d0-4bb8-a704-762e21fa147c service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:13.654291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cabcb-d1d0-4bb8-a704-762e21fa147c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:13.664618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cabcb-d1d0-4bb8-a704-762e21fa147c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:13.666156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cabcb-d1d0-4bb8-a704-762e21fa147c service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:13.677245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 837/1676] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:13.841007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3668b-c448-4569-8044-d0299b2cff7f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:13.842494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a8d3668b-c448-4569-8044-d0299b2cff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:13.865097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:13.990542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3668b-c448-4569-8044-d0299b2cff7f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:13.996131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:13.997372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:13.997993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:13.998591 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] PATH_INFO: `/v3/projects/6df6e6ef677a47498793d478c435bf6a` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:14.000962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df6e6ef677a47498793d478c435bf6a)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:14.020033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:14.171525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cabcb-d1d0-4bb8-a704-762e21fa147c service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:14.173033 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4e4cabcb-d1d0-4bb8-a704-762e21fa147c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:14.205344 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cabcb-d1d0-4bb8-a704-762e21fa147c service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:14.212063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:14.213196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:14.213591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:14.213975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] PATH_INFO: `/v3/users/bf7dcc499f514883a40a85ca98c98ec9` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:14.215364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7dcc499f514883a40a85ca98c98ec9)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:14.217608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:14.283075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df6e6ef677a47498793d478c435bf6a', 'request_id': 'req-01f5130f-2aff-4496-b463-7699e1f2057c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.290885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df6e6ef677a47498793d478c435bf6a', 'request_id': 'req-01f5130f-2aff-4496-b463-7699e1f2057c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.314366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df6e6ef677a47498793d478c435bf6a', 'request_id': 'req-01f5130f-2aff-4496-b463-7699e1f2057c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.464708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] The token cache is being invalidate because project 6df6e6ef677a47498793d478c435bf6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:14.465050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.467376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.470111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 840/1677] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:13 2022] DELETE /identity/v3/projects/6df6e6ef677a47498793d478c435bf6a => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:14.471141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:14.486953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:14.491506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7dcc499f514883a40a85ca98c98ec9'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.493846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7dcc499f514883a40a85ca98c98ec9'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.663309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7dcc499f514883a40a85ca98c98ec9'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.672793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7dcc499f514883a40a85ca98c98ec9'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.691749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7dcc499f514883a40a85ca98c98ec9'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:14.692039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5130f-2aff-4496-b463-7699e1f2057c admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:14.699147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7fe3-928b-432d-9075-820d09997c2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:14.699697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7fe3-928b-432d-9075-820d09997c2c service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:14.700018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7fe3-928b-432d-9075-820d09997c2c service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:14.700421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7fe3-928b-432d-9075-820d09997c2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:14.701880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 838/1678] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:14 2022] DELETE /identity/v3/users/bf7dcc499f514883a40a85ca98c98ec9 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:14.702318 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-255f7fe3-928b-432d-9075-820d09997c2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:14.703229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:14.705077 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:14.845579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350637c-b3a9-49f7-9e63-b3260dcdde62 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:14.875384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8cff9-3e8d-4555-9009-f288e9ed47af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:14.876449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8cff9-3e8d-4555-9009-f288e9ed47af service placement] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:14.876788 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8cff9-3e8d-4555-9009-f288e9ed47af service placement] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:14.878323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8cff9-3e8d-4555-9009-f288e9ed47af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:14.879796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-02c8cff9-3e8d-4555-9009-f288e9ed47af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:14.879954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7fe3-928b-432d-9075-820d09997c2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:14.883466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7fe3-928b-432d-9075-820d09997c2c service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:14.897512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8cff9-3e8d-4555-9009-f288e9ed47af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:14.899510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8cff9-3e8d-4555-9009-f288e9ed47af service placement] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:14.913069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 839/1679] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:14.914776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b29e7-763c-460e-8485-1a0917a5c83d None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:14.915143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b29e7-763c-460e-8485-1a0917a5c83d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:14.915495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b29e7-763c-460e-8485-1a0917a5c83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:14.938958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 841/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:14.938958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ce46-6ae3-4226-bbd6-a5195df5c8b4 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:14.938958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ce46-6ae3-4226-bbd6-a5195df5c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:14.941600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ce46-6ae3-4226-bbd6-a5195df5c8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:14.961701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-6c2b29e7-763c-460e-8485-1a0917a5c83d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:14.967829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6c2b29e7-763c-460e-8485-1a0917a5c83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:14.997327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-3846ce46-6ae3-4226-bbd6-a5195df5c8b4 None None] MFA Rules not processed for user `eb6d9398095c426f9d39eef485c45c66`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:15.003255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3846ce46-6ae3-4226-bbd6-a5195df5c8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:15.146690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 842/1681] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:15.148406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846ce46-6ae3-4226-bbd6-a5195df5c8b4 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:15.149480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 840/1682] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:15.150542 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b29e7-763c-460e-8485-1a0917a5c83d None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:15.152834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6c2b29e7-763c-460e-8485-1a0917a5c83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:15.154628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3846ce46-6ae3-4226-bbd6-a5195df5c8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:15.174522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846ce46-6ae3-4226-bbd6-a5195df5c8b4 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:15.193316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:15.193316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:15.193316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:15.193316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] PATH_INFO: `/v3/users/971d66fc7bd14dd2b2cc1d639639052a` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:15.193572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971d66fc7bd14dd2b2cc1d639639052a)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:15.193643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b29e7-763c-460e-8485-1a0917a5c83d None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:15.193713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: WARNING py.warnings [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:40:15.193713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: warnings.warn(msg) Jun 16 00:40:15.193713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: Jun 16 00:40:15.194014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:15.217667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117bd99-7153-4c80-b115-dfdc050f302c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:15.220218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117bd99-7153-4c80-b115-dfdc050f302c service placement] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:15.227424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117bd99-7153-4c80-b115-dfdc050f302c service placement] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:15.227424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117bd99-7153-4c80-b115-dfdc050f302c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:15.248453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117bd99-7153-4c80-b115-dfdc050f302c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:15.253852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117bd99-7153-4c80-b115-dfdc050f302c service placement] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:15.282544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 841/1683] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:15.284288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f301d63-cb2e-4b7f-95ba-2382cc645df3 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:15.284583 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f301d63-cb2e-4b7f-95ba-2382cc645df3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:15.284869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f301d63-cb2e-4b7f-95ba-2382cc645df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:15.339948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3f301d63-cb2e-4b7f-95ba-2382cc645df3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:15.343310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3f301d63-cb2e-4b7f-95ba-2382cc645df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:15.385363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 842/1684] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:15.385363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257260d-c303-4a23-ab78-eedca3d475a4 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:15.385363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257260d-c303-4a23-ab78-eedca3d475a4 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:15.385363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257260d-c303-4a23-ab78-eedca3d475a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:15.422849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f257260d-c303-4a23-ab78-eedca3d475a4 None None] MFA Rules not processed for user `0dd27b6f42d3412e94e582391a00474c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:15.424826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f257260d-c303-4a23-ab78-eedca3d475a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:15.522307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971d66fc7bd14dd2b2cc1d639639052a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:15.523552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971d66fc7bd14dd2b2cc1d639639052a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:15.545585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 843/1685] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:15.546923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acdb33-11b4-4de3-96e3-d8fd0b6f4c13 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:15.547174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acdb33-11b4-4de3-96e3-d8fd0b6f4c13 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:15.547458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acdb33-11b4-4de3-96e3-d8fd0b6f4c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:15.551066 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971d66fc7bd14dd2b2cc1d639639052a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:15.592150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b1acdb33-11b4-4de3-96e3-d8fd0b6f4c13 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:15.593505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b1acdb33-11b4-4de3-96e3-d8fd0b6f4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:15.605980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 844/1686] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:15.605980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acdb33-11b4-4de3-96e3-d8fd0b6f4c13 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:15.608091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b1acdb33-11b4-4de3-96e3-d8fd0b6f4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:15.674797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971d66fc7bd14dd2b2cc1d639639052a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:15.732756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971d66fc7bd14dd2b2cc1d639639052a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:15.761655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 843/1687] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:15 2022] DELETE /identity/v3/users/971d66fc7bd14dd2b2cc1d639639052a => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:15.763234 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:15.766211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:15.814632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acdb33-11b4-4de3-96e3-d8fd0b6f4c13 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:15.927500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:15.972509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1ecb6-85a2-45b3-acfe-82e1acf32b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:15.973210 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1ecb6-85a2-45b3-acfe-82e1acf32b5f service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:15.973481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1ecb6-85a2-45b3-acfe-82e1acf32b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:15.973759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1ecb6-85a2-45b3-acfe-82e1acf32b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:15.981950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-fca1ecb6-85a2-45b3-acfe-82e1acf32b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:16.002871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d602-635b-462e-9670-f0637ef3fd91 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:16.021961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb13dc0-4036-4784-8172-fe7b2ec78789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:16.022195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1ecb6-85a2-45b3-acfe-82e1acf32b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:16.023144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb13dc0-4036-4784-8172-fe7b2ec78789 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:16.023582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1ecb6-85a2-45b3-acfe-82e1acf32b5f service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:16.023919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb13dc0-4036-4784-8172-fe7b2ec78789 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:16.024399 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb13dc0-4036-4784-8172-fe7b2ec78789 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:16.025390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb13dc0-4036-4784-8172-fe7b2ec78789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:40:16.025943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb13dc0-4036-4784-8172-fe7b2ec78789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:16.028486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb13dc0-4036-4784-8172-fe7b2ec78789 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:16.062552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 844/1688] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:40:16.062552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310e1d-065c-4cbb-b88b-e9ef3dd56c60 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:16.064284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310e1d-065c-4cbb-b88b-e9ef3dd56c60 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:16.064284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310e1d-065c-4cbb-b88b-e9ef3dd56c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:16.073146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 845/1689] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:16.092026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1ecb6-85a2-45b3-acfe-82e1acf32b5f service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:16.107896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1ecb6-85a2-45b3-acfe-82e1acf32b5f service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:16.114290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-64310e1d-065c-4cbb-b88b-e9ef3dd56c60 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:16.121223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-64310e1d-065c-4cbb-b88b-e9ef3dd56c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:16.134303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcdd10-d450-46f7-a8bf-f984669780dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:16.138618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcdd10-d450-46f7-a8bf-f984669780dd admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:16.138922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcdd10-d450-46f7-a8bf-f984669780dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:16.141329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcdd10-d450-46f7-a8bf-f984669780dd admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:16.142224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcdd10-d450-46f7-a8bf-f984669780dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:16.144452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 845/1690] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:16.146785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcdd10-d450-46f7-a8bf-f984669780dd admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:16.165442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64310e1d-065c-4cbb-b88b-e9ef3dd56c60 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:16.174216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-64310e1d-065c-4cbb-b88b-e9ef3dd56c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:16.194205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64310e1d-065c-4cbb-b88b-e9ef3dd56c60 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:16.202791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0dd16-6197-4e4d-9d0f-ee98b6811caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:16.203575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0dd16-6197-4e4d-9d0f-ee98b6811caa service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:16.203952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0dd16-6197-4e4d-9d0f-ee98b6811caa service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:16.204273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0dd16-6197-4e4d-9d0f-ee98b6811caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:16.228119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0dd16-6197-4e4d-9d0f-ee98b6811caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:16.230275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0dd16-6197-4e4d-9d0f-ee98b6811caa service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:16.262891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 846/1691] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:16.333695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 846/1692] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:16 2022] POST /identity/v3/projects => generated 357 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:16.333801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0dd16-6197-4e4d-9d0f-ee98b6811caa service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:16.342067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0dd16-6197-4e4d-9d0f-ee98b6811caa service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:16.504553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d98c6-1aee-4e2c-b111-757f498dc4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:16.505248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d98c6-1aee-4e2c-b111-757f498dc4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:16.506353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d98c6-1aee-4e2c-b111-757f498dc4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:16.506353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d98c6-1aee-4e2c-b111-757f498dc4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:16.506779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d98c6-1aee-4e2c-b111-757f498dc4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:16.508785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d98c6-1aee-4e2c-b111-757f498dc4c5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:16.671025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 847/1693] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:16 2022] POST /identity/v3/users => generated 279 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:16.675367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcdd10-d450-46f7-a8bf-f984669780dd admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:16.691434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcdd10-d450-46f7-a8bf-f984669780dd admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:16.708025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9368aff-4aa1-445a-8954-5e56efa7b84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:16.708778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9368aff-4aa1-445a-8954-5e56efa7b84d admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:16.709069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9368aff-4aa1-445a-8954-5e56efa7b84d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:16.709349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9368aff-4aa1-445a-8954-5e56efa7b84d admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:16.711275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9368aff-4aa1-445a-8954-5e56efa7b84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:16.716569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9368aff-4aa1-445a-8954-5e56efa7b84d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:16.746621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 847/1694] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:40:16.750052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d98c6-1aee-4e2c-b111-757f498dc4c5 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:16.764396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d98c6-1aee-4e2c-b111-757f498dc4c5 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:16.775376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83ab22-7d68-472d-9616-5af78b6fcd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:16.777588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83ab22-7d68-472d-9616-5af78b6fcd13 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:16.779175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83ab22-7d68-472d-9616-5af78b6fcd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:16.779624 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83ab22-7d68-472d-9616-5af78b6fcd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:16.780585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83ab22-7d68-472d-9616-5af78b6fcd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:16.800414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83ab22-7d68-472d-9616-5af78b6fcd13 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:16.808966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:16.845505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 848/1695] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:16.850033 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9368aff-4aa1-445a-8954-5e56efa7b84d admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:16.866824 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9368aff-4aa1-445a-8954-5e56efa7b84d admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:16.882113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa85d4f-b02e-4e42-9681-839fce7195dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:16.883094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa85d4f-b02e-4e42-9681-839fce7195dc admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:16.883523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa85d4f-b02e-4e42-9681-839fce7195dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:16.885014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa85d4f-b02e-4e42-9681-839fce7195dc admin admin] PATH_INFO: `/v3/projects/3e6f767f384349e997ab7014963e3f41/users/de0b851b8c664010a0aadea6cf542943/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:16.934729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa85d4f-b02e-4e42-9681-839fce7195dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6f767f384349e997ab7014963e3f41, user_id=de0b851b8c664010a0aadea6cf542943, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:16.944979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa85d4f-b02e-4e42-9681-839fce7195dc admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:17.097419 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 848/1696] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:16 2022] PUT /identity/v3/projects/3e6f767f384349e997ab7014963e3f41/users/de0b851b8c664010a0aadea6cf542943/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:17.110218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5f894-009d-4a13-a933-eef0c63d2c7f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:17.110505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5f894-009d-4a13-a933-eef0c63d2c7f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:17.110781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5f894-009d-4a13-a933-eef0c63d2c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:17.215055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a3b5f894-009d-4a13-a933-eef0c63d2c7f None None] MFA Rules not processed for user `de0b851b8c664010a0aadea6cf542943`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:17.218620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a3b5f894-009d-4a13-a933-eef0c63d2c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:17.514658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa85d4f-b02e-4e42-9681-839fce7195dc admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:17.530751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 849/1697] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:17.670341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa85d4f-b02e-4e42-9681-839fce7195dc admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:17.687438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674c728-2ccd-4af3-ae2a-5eaedecd4695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:17.688584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674c728-2ccd-4af3-ae2a-5eaedecd4695 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:17.701447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674c728-2ccd-4af3-ae2a-5eaedecd4695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:17.706970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674c728-2ccd-4af3-ae2a-5eaedecd4695 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:17.709317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674c728-2ccd-4af3-ae2a-5eaedecd4695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:17.714121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674c728-2ccd-4af3-ae2a-5eaedecd4695 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:17.865092 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 849/1698] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:17 2022] POST /identity/v3/projects => generated 357 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:17.872199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5f894-009d-4a13-a933-eef0c63d2c7f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:17.928370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5f894-009d-4a13-a933-eef0c63d2c7f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:18.046034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674c728-2ccd-4af3-ae2a-5eaedecd4695 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:18.052813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d674c728-2ccd-4af3-ae2a-5eaedecd4695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:18.129030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b1b57-a651-499a-9cea-0877f3020be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:18.129394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b1b57-a651-499a-9cea-0877f3020be2 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:18.129672 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b1b57-a651-499a-9cea-0877f3020be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:18.130266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b1b57-a651-499a-9cea-0877f3020be2 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:18.130976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b1b57-a651-499a-9cea-0877f3020be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:18.133616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b1b57-a651-499a-9cea-0877f3020be2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:18.234032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674c728-2ccd-4af3-ae2a-5eaedecd4695 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:18.240511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:18.242075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:18.242730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:18.243720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] PATH_INFO: `/v3/projects/bbe8b4f41eea4b3785e9c74ef8613523` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:18.246497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe8b4f41eea4b3785e9c74ef8613523)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:18.248261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: WARNING py.warnings [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:40:18.248261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: warnings.warn(msg) Jun 16 00:40:18.248261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: Jun 16 00:40:18.258352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:18.320785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 850/1699] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:17 2022] POST /identity/v3/users => generated 285 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:18.325032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b1b57-a651-499a-9cea-0877f3020be2 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:18.343810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b1b57-a651-499a-9cea-0877f3020be2 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:18.349698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def65870-b448-4fc4-a0f2-616114476807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:18.350538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65870-b448-4fc4-a0f2-616114476807 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:18.350965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65870-b448-4fc4-a0f2-616114476807 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:18.351384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65870-b448-4fc4-a0f2-616114476807 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:18.352283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def65870-b448-4fc4-a0f2-616114476807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:18.354103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def65870-b448-4fc4-a0f2-616114476807 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:18.367807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 851/1700] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:18.383993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def65870-b448-4fc4-a0f2-616114476807 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:18.411408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def65870-b448-4fc4-a0f2-616114476807 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:18.430600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4b735-8ab1-439e-903b-6446b96bcb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:18.431893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4b735-8ab1-439e-903b-6446b96bcb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:18.433917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4b735-8ab1-439e-903b-6446b96bcb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:18.436808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4b735-8ab1-439e-903b-6446b96bcb75 admin admin] PATH_INFO: `/v3/projects/f4e43098d29f4d30bb62b4d7022c7643/users/b5e2aeefe5c445e58c3137bdecfbba65/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:18.505195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4b735-8ab1-439e-903b-6446b96bcb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e43098d29f4d30bb62b4d7022c7643, user_id=b5e2aeefe5c445e58c3137bdecfbba65, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:18.506632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe8b4f41eea4b3785e9c74ef8613523', 'request_id': 'req-46868e23-735c-4af2-90c1-ef95ea991a41'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:18.521113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4b735-8ab1-439e-903b-6446b96bcb75 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:18.589661 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe8b4f41eea4b3785e9c74ef8613523', 'request_id': 'req-46868e23-735c-4af2-90c1-ef95ea991a41'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:18.613015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 852/1701] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:18 2022] PUT /identity/v3/projects/f4e43098d29f4d30bb62b4d7022c7643/users/b5e2aeefe5c445e58c3137bdecfbba65/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:18.614996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4b735-8ab1-439e-903b-6446b96bcb75 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:18.618954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-82a4b735-8ab1-439e-903b-6446b96bcb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:18.705447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe8b4f41eea4b3785e9c74ef8613523', 'request_id': 'req-46868e23-735c-4af2-90c1-ef95ea991a41'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:18.724957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] The token cache is being invalidate because project bbe8b4f41eea4b3785e9c74ef8613523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:18.725441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:18.728157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:18.733608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 850/1702] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:18 2022] DELETE /identity/v3/projects/bbe8b4f41eea4b3785e9c74ef8613523 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:18.734497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:18.740628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:18.745162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:18.803880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4b735-8ab1-439e-903b-6446b96bcb75 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:18.852569 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:18.853477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:18.853769 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:18.854048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] PATH_INFO: `/v3/projects/c826d9677b32460e9b75efb935a42dfe` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:18.857918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c826d9677b32460e9b75efb935a42dfe)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:18.865933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:18.952555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46868e23-735c-4af2-90c1-ef95ea991a41 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:18.959986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdb052-1550-42e1-ad8c-6211870c1f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:18.960777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb052-1550-42e1-ad8c-6211870c1f29 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:18.961386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb052-1550-42e1-ad8c-6211870c1f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:18.961386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb052-1550-42e1-ad8c-6211870c1f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:18.961985 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdb052-1550-42e1-ad8c-6211870c1f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:18.963619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdb052-1550-42e1-ad8c-6211870c1f29 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:18.991661 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 851/1703] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:18.993184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8163e7-0e23-44db-9e0c-f9c059187acd None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:18.993482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8163e7-0e23-44db-9e0c-f9c059187acd None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:18.993762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8163e7-0e23-44db-9e0c-f9c059187acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:19.033858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4e8163e7-0e23-44db-9e0c-f9c059187acd None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:19.040523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4e8163e7-0e23-44db-9e0c-f9c059187acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:19.051568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 852/1704] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:19.052852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8163e7-0e23-44db-9e0c-f9c059187acd None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:19.064101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8163e7-0e23-44db-9e0c-f9c059187acd None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:19.086687 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1557a-3139-4a79-b35e-4d9d7aace5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:19.087654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1557a-3139-4a79-b35e-4d9d7aace5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:19.087991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1557a-3139-4a79-b35e-4d9d7aace5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:19.088268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1557a-3139-4a79-b35e-4d9d7aace5ac admin admin] PATH_INFO: `/v3/projects/f4e43098d29f4d30bb62b4d7022c7643/users/b5e2aeefe5c445e58c3137bdecfbba65/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:19.091013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1557a-3139-4a79-b35e-4d9d7aace5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e43098d29f4d30bb62b4d7022c7643, user_id=b5e2aeefe5c445e58c3137bdecfbba65, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:19.093726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1557a-3139-4a79-b35e-4d9d7aace5ac admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:19.115923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 853/1705] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:19 2022] PUT /identity/v3/projects/f4e43098d29f4d30bb62b4d7022c7643/users/b5e2aeefe5c445e58c3137bdecfbba65/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:19.115923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eae87a-c207-4179-a226-dbd8c1af285a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:19.115923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eae87a-c207-4179-a226-dbd8c1af285a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:19.115923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eae87a-c207-4179-a226-dbd8c1af285a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:19.147937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c2eae87a-c207-4179-a226-dbd8c1af285a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:19.149216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c2eae87a-c207-4179-a226-dbd8c1af285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:19.158113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c826d9677b32460e9b75efb935a42dfe', 'request_id': 'req-081006e2-9017-48ca-a164-75a9ee9e20b7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:19.164167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c826d9677b32460e9b75efb935a42dfe', 'request_id': 'req-081006e2-9017-48ca-a164-75a9ee9e20b7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:19.186801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c826d9677b32460e9b75efb935a42dfe', 'request_id': 'req-081006e2-9017-48ca-a164-75a9ee9e20b7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:19.241924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 854/1706] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:19.241924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ff0c-0875-4925-9cea-21b0046f5694 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:19.242879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ff0c-0875-4925-9cea-21b0046f5694 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:19.243337 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ff0c-0875-4925-9cea-21b0046f5694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:19.310138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3c24ff0c-0875-4925-9cea-21b0046f5694 None None] MFA Rules not processed for user `b5e2aeefe5c445e58c3137bdecfbba65`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:19.320102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3c24ff0c-0875-4925-9cea-21b0046f5694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:19.322081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] The token cache is being invalidate because project c826d9677b32460e9b75efb935a42dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:19.322530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:19.325745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:19.326843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 853/1707] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:18 2022] DELETE /identity/v3/projects/c826d9677b32460e9b75efb935a42dfe => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:19.327872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:19.330993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:19.362844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081006e2-9017-48ca-a164-75a9ee9e20b7 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:19.381104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:19.382940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:19.383382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:19.384165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:19.387356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:40:19.388747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:19.396441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:19.421931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 854/1708] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:40:19.426986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:19.427537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:19.468707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00c170-5753-47eb-b32f-b9394bfde933 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:19.476811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:19.477995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:19.478425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:19.478920 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] PATH_INFO: `/v3/users/720cedd0a57e4e92a1e4aa690af9fc07` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:19.487988 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=720cedd0a57e4e92a1e4aa690af9fc07)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:19.490470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:19.516492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 855/1709] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:19 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:19.545546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ff0c-0875-4925-9cea-21b0046f5694 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:19.547409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:19.562888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ff0c-0875-4925-9cea-21b0046f5694 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:19.591640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f810f3a-696b-4857-b2e1-fde41fd8909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:19.592770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f810f3a-696b-4857-b2e1-fde41fd8909f admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:19.593071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f810f3a-696b-4857-b2e1-fde41fd8909f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:19.595570 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f810f3a-696b-4857-b2e1-fde41fd8909f admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:19.596747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f810f3a-696b-4857-b2e1-fde41fd8909f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:19.601566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f810f3a-696b-4857-b2e1-fde41fd8909f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:19.800152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 856/1710] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:19 2022] POST /identity/v3/projects => generated 369 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:19.811995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f810f3a-696b-4857-b2e1-fde41fd8909f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:19.818651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0f810f3a-696b-4857-b2e1-fde41fd8909f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:19.834173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '720cedd0a57e4e92a1e4aa690af9fc07'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:19.836068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '720cedd0a57e4e92a1e4aa690af9fc07'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:19.879088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '720cedd0a57e4e92a1e4aa690af9fc07'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:20.011810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '720cedd0a57e4e92a1e4aa690af9fc07'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:20.031222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '720cedd0a57e4e92a1e4aa690af9fc07'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:20.049186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 855/1711] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:19 2022] DELETE /identity/v3/users/720cedd0a57e4e92a1e4aa690af9fc07 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:20.054298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:20.054511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f810f3a-696b-4857-b2e1-fde41fd8909f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:20.054946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:20.220423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349adba-af65-4015-85e2-206d18315c86 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:20.233324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873693-c3f7-468a-bd03-e0ec580936bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:20.234021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873693-c3f7-468a-bd03-e0ec580936bf admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:20.238609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873693-c3f7-468a-bd03-e0ec580936bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:20.238609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873693-c3f7-468a-bd03-e0ec580936bf admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:20.238609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13873693-c3f7-468a-bd03-e0ec580936bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:20.238609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13873693-c3f7-468a-bd03-e0ec580936bf admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:20.262218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db9bd6-34ff-463f-97df-93cc4787a11a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:20.262617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db9bd6-34ff-463f-97df-93cc4787a11a service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:20.262906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db9bd6-34ff-463f-97df-93cc4787a11a service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:20.263190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db9bd6-34ff-463f-97df-93cc4787a11a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:20.267072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-18db9bd6-34ff-463f-97df-93cc4787a11a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:20.386188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 856/1712] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:20 2022] POST /identity/v3/users => generated 285 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:20.387619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873693-c3f7-468a-bd03-e0ec580936bf admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:20.425236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873693-c3f7-468a-bd03-e0ec580936bf admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:20.427759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db9bd6-34ff-463f-97df-93cc4787a11a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:20.429231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db9bd6-34ff-463f-97df-93cc4787a11a service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:20.436553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d736a-5e77-4105-8f14-acaa2e7501be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:20.437519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d736a-5e77-4105-8f14-acaa2e7501be admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:20.437951 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d736a-5e77-4105-8f14-acaa2e7501be admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:20.438385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d736a-5e77-4105-8f14-acaa2e7501be admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:20.439259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d736a-5e77-4105-8f14-acaa2e7501be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:20.441173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d736a-5e77-4105-8f14-acaa2e7501be admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:20.448168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 857/1713] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:19 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:20.466538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 857/1714] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:20.470891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db9bd6-34ff-463f-97df-93cc4787a11a service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:20.492476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db9bd6-34ff-463f-97df-93cc4787a11a service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:20.520614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96755c7b-247f-4195-9ae4-42153e57b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:20.521322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96755c7b-247f-4195-9ae4-42153e57b4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:20.521615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96755c7b-247f-4195-9ae4-42153e57b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:20.521916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96755c7b-247f-4195-9ae4-42153e57b4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:20.522673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96755c7b-247f-4195-9ae4-42153e57b4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:20.524370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96755c7b-247f-4195-9ae4-42153e57b4f4 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:20.544714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 858/1715] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:20.546062 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d736a-5e77-4105-8f14-acaa2e7501be admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:20.564887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d736a-5e77-4105-8f14-acaa2e7501be admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:20.573000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd79db-1059-451d-925d-13405b520f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:20.574778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd79db-1059-451d-925d-13405b520f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:20.575069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd79db-1059-451d-925d-13405b520f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:20.575395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd79db-1059-451d-925d-13405b520f5c admin admin] PATH_INFO: `/v3/projects/03ddb49f3aca49e59c2baceb85a01102/users/884e7c490d204a928a493e8abf0ca0cc/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:20.596530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd79db-1059-451d-925d-13405b520f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ddb49f3aca49e59c2baceb85a01102, user_id=884e7c490d204a928a493e8abf0ca0cc, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:20.599303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd79db-1059-451d-925d-13405b520f5c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:20.729172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 858/1716] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:20 2022] PUT /identity/v3/projects/03ddb49f3aca49e59c2baceb85a01102/users/884e7c490d204a928a493e8abf0ca0cc/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:20.739476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55553b-aae0-4f6c-b480-175bbb1a1169 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:20.739796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55553b-aae0-4f6c-b480-175bbb1a1169 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:20.740087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55553b-aae0-4f6c-b480-175bbb1a1169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:20.776019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd79db-1059-451d-925d-13405b520f5c admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:20.778732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-75cd79db-1059-451d-925d-13405b520f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:20.829703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-bd55553b-aae0-4f6c-b480-175bbb1a1169 None None] MFA Rules not processed for user `884e7c490d204a928a493e8abf0ca0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:20.833098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-bd55553b-aae0-4f6c-b480-175bbb1a1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:20.951469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd79db-1059-451d-925d-13405b520f5c admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:20.959750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06e820-cef8-43fe-9f6e-ef0ddf8c8b17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:20.960434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06e820-cef8-43fe-9f6e-ef0ddf8c8b17 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:20.963514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06e820-cef8-43fe-9f6e-ef0ddf8c8b17 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:20.964394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06e820-cef8-43fe-9f6e-ef0ddf8c8b17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:20.970957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-bf06e820-cef8-43fe-9f6e-ef0ddf8c8b17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:21.081754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 859/1717] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:21.086391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55553b-aae0-4f6c-b480-175bbb1a1169 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:21.237222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06e820-cef8-43fe-9f6e-ef0ddf8c8b17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:21.237222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06e820-cef8-43fe-9f6e-ef0ddf8c8b17 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:21.266181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 859/1718] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:20 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:21.300176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55553b-aae0-4f6c-b480-175bbb1a1169 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:21.309673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22597f89-2ea8-46f2-94e2-db0c32146ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:21.310579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22597f89-2ea8-46f2-94e2-db0c32146ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:21.310706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22597f89-2ea8-46f2-94e2-db0c32146ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:21.311358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22597f89-2ea8-46f2-94e2-db0c32146ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:21.311830 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22597f89-2ea8-46f2-94e2-db0c32146ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:21.313778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22597f89-2ea8-46f2-94e2-db0c32146ae6 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:21.455813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09813d-4dd1-4441-9b14-bd0c45069693 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:21.456132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09813d-4dd1-4441-9b14-bd0c45069693 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:21.456686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09813d-4dd1-4441-9b14-bd0c45069693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:21.522049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5b09813d-4dd1-4441-9b14-bd0c45069693 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:21.523279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5b09813d-4dd1-4441-9b14-bd0c45069693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:21.561701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 860/1719] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:21 2022] POST /identity/v3/projects => generated 367 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:21.565987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22597f89-2ea8-46f2-94e2-db0c32146ae6 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:21.726910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 860/1720] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:40:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:21.729341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bccb7-8194-46c3-be98-0cde9961cd91 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:21.733720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bccb7-8194-46c3-be98-0cde9961cd91 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:21.734139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bccb7-8194-46c3-be98-0cde9961cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:21.771131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22597f89-2ea8-46f2-94e2-db0c32146ae6 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:21.773102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e33bccb7-8194-46c3-be98-0cde9961cd91 None None] MFA Rules not processed for user `9158887f572545039af31a513c2bc0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:21.777655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e33bccb7-8194-46c3-be98-0cde9961cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:21.783583 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1e06-0f76-49a9-8bcd-6bba140bbb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:21.784471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1e06-0f76-49a9-8bcd-6bba140bbb94 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:21.785079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1e06-0f76-49a9-8bcd-6bba140bbb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:21.785567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1e06-0f76-49a9-8bcd-6bba140bbb94 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:21.786477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec1e06-0f76-49a9-8bcd-6bba140bbb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:21.788812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec1e06-0f76-49a9-8bcd-6bba140bbb94 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:21.917754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 861/1721] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:21.974184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 861/1722] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:21 2022] POST /identity/v3/users => generated 290 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:21.978122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bccb7-8194-46c3-be98-0cde9961cd91 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:22.004667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bccb7-8194-46c3-be98-0cde9961cd91 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:22.010477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981a903-4e77-4ee7-8f71-486d3af138f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:22.011673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981a903-4e77-4ee7-8f71-486d3af138f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:22.012202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981a903-4e77-4ee7-8f71-486d3af138f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:22.012641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981a903-4e77-4ee7-8f71-486d3af138f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:22.013754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981a903-4e77-4ee7-8f71-486d3af138f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:22.026549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981a903-4e77-4ee7-8f71-486d3af138f0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:22.064122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 862/1723] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:22.071654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1e06-0f76-49a9-8bcd-6bba140bbb94 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:22.090155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1e06-0f76-49a9-8bcd-6bba140bbb94 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:22.116478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace0916-16a5-4ee0-b345-bff29ee5de4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:22.117698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0916-16a5-4ee0-b345-bff29ee5de4f admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:22.118303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0916-16a5-4ee0-b345-bff29ee5de4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:22.123249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0916-16a5-4ee0-b345-bff29ee5de4f admin admin] PATH_INFO: `/v3/projects/7d340cf304f34f9d812c5c6c9d1fa1e8/users/b625c91ff8854234970dddcdc7f1a98f/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:22.161280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace0916-16a5-4ee0-b345-bff29ee5de4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d340cf304f34f9d812c5c6c9d1fa1e8, user_id=b625c91ff8854234970dddcdc7f1a98f, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:22.168611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace0916-16a5-4ee0-b345-bff29ee5de4f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:22.198785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981a903-4e77-4ee7-8f71-486d3af138f0 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:22.200832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d981a903-4e77-4ee7-8f71-486d3af138f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:22.332254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981a903-4e77-4ee7-8f71-486d3af138f0 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:22.337496 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:22.364749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 862/1724] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:22 2022] PUT /identity/v3/projects/7d340cf304f34f9d812c5c6c9d1fa1e8/users/b625c91ff8854234970dddcdc7f1a98f/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:22.365790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace0916-16a5-4ee0-b345-bff29ee5de4f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:22.382057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1ace0916-16a5-4ee0-b345-bff29ee5de4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:22.475514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798762ae-1ed0-44b5-b05e-7ea3a3629dfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:22.476656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798762ae-1ed0-44b5-b05e-7ea3a3629dfa service swift] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:22.480430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798762ae-1ed0-44b5-b05e-7ea3a3629dfa service swift] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:22.481030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798762ae-1ed0-44b5-b05e-7ea3a3629dfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:22.618114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace0916-16a5-4ee0-b345-bff29ee5de4f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:22.625753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:22.626772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:22.626921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:22.627255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] PATH_INFO: `/v3/projects/79ba45fb353a42cea43bf243fdafe4c8` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:22.628554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ba45fb353a42cea43bf243fdafe4c8)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:22.630740 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:22.640942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798762ae-1ed0-44b5-b05e-7ea3a3629dfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:22.645258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798762ae-1ed0-44b5-b05e-7ea3a3629dfa service swift] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:22.664520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 863/1725] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:40:22.681343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798762ae-1ed0-44b5-b05e-7ea3a3629dfa service swift] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:22.707288 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798762ae-1ed0-44b5-b05e-7ea3a3629dfa service swift] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:22.716702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922ef40-fd35-4eb4-ac86-4954fc99dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:22.720013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922ef40-fd35-4eb4-ac86-4954fc99dbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:22.720540 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922ef40-fd35-4eb4-ac86-4954fc99dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:22.720957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922ef40-fd35-4eb4-ac86-4954fc99dbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:22.721834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922ef40-fd35-4eb4-ac86-4954fc99dbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:22.727218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922ef40-fd35-4eb4-ac86-4954fc99dbb9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:22.747058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 864/1726] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:22.751569 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922ef40-fd35-4eb4-ac86-4954fc99dbb9 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:22.786694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922ef40-fd35-4eb4-ac86-4954fc99dbb9 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:22.799462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603934c-8abf-4573-b9fe-5ce7823a0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:22.800821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603934c-8abf-4573-b9fe-5ce7823a0426 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:22.801796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603934c-8abf-4573-b9fe-5ce7823a0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:22.804352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603934c-8abf-4573-b9fe-5ce7823a0426 admin admin] PATH_INFO: `/v3/projects/7d340cf304f34f9d812c5c6c9d1fa1e8/users/b625c91ff8854234970dddcdc7f1a98f/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:22.809980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603934c-8abf-4573-b9fe-5ce7823a0426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d340cf304f34f9d812c5c6c9d1fa1e8, user_id=b625c91ff8854234970dddcdc7f1a98f, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:22.818104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603934c-8abf-4573-b9fe-5ce7823a0426 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:22.858352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 865/1727] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:22 2022] PUT /identity/v3/projects/7d340cf304f34f9d812c5c6c9d1fa1e8/users/b625c91ff8854234970dddcdc7f1a98f/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:22.868658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7d8c-80c6-416f-b490-28364a4566a4 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:22.872515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7d8c-80c6-416f-b490-28364a4566a4 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:22.872515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7d8c-80c6-416f-b490-28364a4566a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:22.896555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ba45fb353a42cea43bf243fdafe4c8', 'request_id': 'req-de965745-b54b-4728-ad16-eb9b770a2c91'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:22.912463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ba45fb353a42cea43bf243fdafe4c8', 'request_id': 'req-de965745-b54b-4728-ad16-eb9b770a2c91'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:22.977988 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-230e7d8c-80c6-416f-b490-28364a4566a4 None None] MFA Rules not processed for user `b625c91ff8854234970dddcdc7f1a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:22.979309 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-230e7d8c-80c6-416f-b490-28364a4566a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:23.121509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ba45fb353a42cea43bf243fdafe4c8', 'request_id': 'req-de965745-b54b-4728-ad16-eb9b770a2c91'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:23.162057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] The token cache is being invalidate because project 79ba45fb353a42cea43bf243fdafe4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:23.162057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:23.162057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-de965745-b54b-4728-ad16-eb9b770a2c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:23.177602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 863/1728] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:22 2022] DELETE /identity/v3/projects/79ba45fb353a42cea43bf243fdafe4c8 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:23.179200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1cbc-a9f2-4fa2-8256-f39e9a550ce3 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:23.191213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1cbc-a9f2-4fa2-8256-f39e9a550ce3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:23.191637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1cbc-a9f2-4fa2-8256-f39e9a550ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:23.233118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 866/1729] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:23.240683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4fed1cbc-a9f2-4fa2-8256-f39e9a550ce3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:23.242962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4fed1cbc-a9f2-4fa2-8256-f39e9a550ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:23.248145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7d8c-80c6-416f-b490-28364a4566a4 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:23.253562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-230e7d8c-80c6-416f-b490-28364a4566a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:23.392569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 864/1730] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:23.409285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563189f8-27f8-4eb4-828c-d85dee510fc0 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:23.411300 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563189f8-27f8-4eb4-828c-d85dee510fc0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:23.411895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563189f8-27f8-4eb4-828c-d85dee510fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:23.418893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7d8c-80c6-416f-b490-28364a4566a4 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:23.430794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b6373-6a0e-49ac-916e-eb13a4d1e994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:23.431581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b6373-6a0e-49ac-916e-eb13a4d1e994 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:23.432030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b6373-6a0e-49ac-916e-eb13a4d1e994 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:23.432422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b6373-6a0e-49ac-916e-eb13a4d1e994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:23.453904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b6373-6a0e-49ac-916e-eb13a4d1e994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:23.455482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b6373-6a0e-49ac-916e-eb13a4d1e994 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:23.477122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 867/1731] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:23.487166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-563189f8-27f8-4eb4-828c-d85dee510fc0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:23.495359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-563189f8-27f8-4eb4-828c-d85dee510fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:23.537622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 865/1732] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:23.538740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b6373-6a0e-49ac-916e-eb13a4d1e994 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:23.574458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b6373-6a0e-49ac-916e-eb13a4d1e994 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:23.578482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:23.586186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683084-3f8f-450a-809a-1953f8dcbffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:23.599941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683084-3f8f-450a-809a-1953f8dcbffa admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:23.602366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683084-3f8f-450a-809a-1953f8dcbffa admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:23.602803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683084-3f8f-450a-809a-1953f8dcbffa admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:23.605223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c683084-3f8f-450a-809a-1953f8dcbffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:40:23.605813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c683084-3f8f-450a-809a-1953f8dcbffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:23.611554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c683084-3f8f-450a-809a-1953f8dcbffa admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:23.634032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 868/1733] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:40:23.644019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563189f8-27f8-4eb4-828c-d85dee510fc0 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:23.659011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563189f8-27f8-4eb4-828c-d85dee510fc0 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:23.677383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0357bfe-7b6d-4968-841f-3cfe00843624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:23.680104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0357bfe-7b6d-4968-841f-3cfe00843624 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:23.680646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0357bfe-7b6d-4968-841f-3cfe00843624 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:23.681074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0357bfe-7b6d-4968-841f-3cfe00843624 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:23.682522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0357bfe-7b6d-4968-841f-3cfe00843624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:23.685513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0357bfe-7b6d-4968-841f-3cfe00843624 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:23.790841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683084-3f8f-450a-809a-1953f8dcbffa admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:23.817993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683084-3f8f-450a-809a-1953f8dcbffa admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:23.830514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ee0ac-43c1-4ab8-a6db-fae8eaadbd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:23.833198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ee0ac-43c1-4ab8-a6db-fae8eaadbd27 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:23.834860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ee0ac-43c1-4ab8-a6db-fae8eaadbd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:23.835516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ee0ac-43c1-4ab8-a6db-fae8eaadbd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:23.841960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-bb9ee0ac-43c1-4ab8-a6db-fae8eaadbd27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:23.869597 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 866/1734] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:23 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:23.874257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0357bfe-7b6d-4968-841f-3cfe00843624 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:23.935402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ee0ac-43c1-4ab8-a6db-fae8eaadbd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:23.951856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ee0ac-43c1-4ab8-a6db-fae8eaadbd27 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:23.997528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 869/1735] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:24.152900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0357bfe-7b6d-4968-841f-3cfe00843624 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:24.169620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf730e2-4aab-48e0-9c1b-98992705281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:24.170128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf730e2-4aab-48e0-9c1b-98992705281f admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:24.170604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf730e2-4aab-48e0-9c1b-98992705281f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:24.171183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf730e2-4aab-48e0-9c1b-98992705281f admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:24.172367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf730e2-4aab-48e0-9c1b-98992705281f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:24.177819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf730e2-4aab-48e0-9c1b-98992705281f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:24.679884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 867/1736] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:23 2022] POST /identity/v3/users => generated 289 bytes in 780 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:24.680095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ee0ac-43c1-4ab8-a6db-fae8eaadbd27 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:24.688125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ee0ac-43c1-4ab8-a6db-fae8eaadbd27 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:24.702920 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69608d-84db-4264-ba19-fc438ec2704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:24.703663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69608d-84db-4264-ba19-fc438ec2704d admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:24.703987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69608d-84db-4264-ba19-fc438ec2704d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:24.704271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69608d-84db-4264-ba19-fc438ec2704d admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:24.705027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69608d-84db-4264-ba19-fc438ec2704d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:24.709055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69608d-84db-4264-ba19-fc438ec2704d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:24.745446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf730e2-4aab-48e0-9c1b-98992705281f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:24.745881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 870/1737] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:24.763502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf730e2-4aab-48e0-9c1b-98992705281f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:24.773946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b793d-158e-4f07-8b31-98d5a8ed332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:24.774731 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b793d-158e-4f07-8b31-98d5a8ed332d admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:24.774914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b793d-158e-4f07-8b31-98d5a8ed332d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:24.775365 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b793d-158e-4f07-8b31-98d5a8ed332d admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:24.776386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b793d-158e-4f07-8b31-98d5a8ed332d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:24.778275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b793d-158e-4f07-8b31-98d5a8ed332d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:24.809703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 868/1738] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:24.815434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69608d-84db-4264-ba19-fc438ec2704d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:24.831512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69608d-84db-4264-ba19-fc438ec2704d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:24.845052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9e029-a579-4b0d-8e84-f462c5f2f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:24.846390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9e029-a579-4b0d-8e84-f462c5f2f218 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:24.846906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9e029-a579-4b0d-8e84-f462c5f2f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:24.855341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9e029-a579-4b0d-8e84-f462c5f2f218 admin admin] PATH_INFO: `/v3/projects/38d516bd37aa459a8e3f050f4f3de004/users/eae60fc0fd1146ee9df3ecda05aedc7a/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:24.900915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9e029-a579-4b0d-8e84-f462c5f2f218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d516bd37aa459a8e3f050f4f3de004, user_id=eae60fc0fd1146ee9df3ecda05aedc7a, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:24.905252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9e029-a579-4b0d-8e84-f462c5f2f218 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:26.667432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 871/1739] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:24 2022] PUT /identity/v3/projects/38d516bd37aa459a8e3f050f4f3de004/users/eae60fc0fd1146ee9df3ecda05aedc7a/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 1853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:26.677482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812f860-9baf-4ea1-926e-c5ebed2b896a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:26.678079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812f860-9baf-4ea1-926e-c5ebed2b896a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:26.678547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812f860-9baf-4ea1-926e-c5ebed2b896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:26.719795 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9812f860-9baf-4ea1-926e-c5ebed2b896a None None] MFA Rules not processed for user `eae60fc0fd1146ee9df3ecda05aedc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:26.722568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9812f860-9baf-4ea1-926e-c5ebed2b896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:26.859681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 869/1740] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:26.863945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9e029-a579-4b0d-8e84-f462c5f2f218 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:26.932321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:27.037528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9e029-a579-4b0d-8e84-f462c5f2f218 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:27.065189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ecbd-535f-4e7a-a8d1-17561288dfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:27.065189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ecbd-535f-4e7a-a8d1-17561288dfc6 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:27.065189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ecbd-535f-4e7a-a8d1-17561288dfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:27.065189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ecbd-535f-4e7a-a8d1-17561288dfc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:27.065486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9ecbd-535f-4e7a-a8d1-17561288dfc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:27.065486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9ecbd-535f-4e7a-a8d1-17561288dfc6 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:27.219944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840553b-f703-472b-85e7-63b6902bbc30 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:27.219944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840553b-f703-472b-85e7-63b6902bbc30 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:27.219944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840553b-f703-472b-85e7-63b6902bbc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:27.278390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 872/1741] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:26 2022] POST /identity/v3/projects => generated 377 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:27.280166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3840553b-f703-472b-85e7-63b6902bbc30 None None] MFA Rules not processed for user `20b4902b340a4260a0b5f716c3ae9acf`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:27.282131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ecbd-535f-4e7a-a8d1-17561288dfc6 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:27.287789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3840553b-f703-472b-85e7-63b6902bbc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:27.577450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 870/1742] 10.222.0.30 () {58 vars in 1015 bytes} [Thu Jun 16 00:40:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:27.598415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840553b-f703-472b-85e7-63b6902bbc30 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:27.600402 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3840553b-f703-472b-85e7-63b6902bbc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:27.628577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840553b-f703-472b-85e7-63b6902bbc30 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:27.642209 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c11b20-93e6-4877-8408-d1e7278207cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:27.642764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c11b20-93e6-4877-8408-d1e7278207cf service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:27.643056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c11b20-93e6-4877-8408-d1e7278207cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:27.643336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c11b20-93e6-4877-8408-d1e7278207cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:27.648285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ecbd-535f-4e7a-a8d1-17561288dfc6 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:27.651637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c11b20-93e6-4877-8408-d1e7278207cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:27.653118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c11b20-93e6-4877-8408-d1e7278207cf service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:27.668083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2c49-3b05-4093-83fd-f2a650f79dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:27.668790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2c49-3b05-4093-83fd-f2a650f79dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:27.673472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2c49-3b05-4093-83fd-f2a650f79dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:27.673472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2c49-3b05-4093-83fd-f2a650f79dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:27.673472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b2c49-3b05-4093-83fd-f2a650f79dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:27.673472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b2c49-3b05-4093-83fd-f2a650f79dc2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:27.689229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 871/1743] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:40:27.702169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c11b20-93e6-4877-8408-d1e7278207cf service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:27.704274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-88c11b20-93e6-4877-8408-d1e7278207cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:27.734812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c11b20-93e6-4877-8408-d1e7278207cf service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:27.749820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15ce3-25dd-4b27-835c-709ef427055c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:27.750577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15ce3-25dd-4b27-835c-709ef427055c service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:27.751122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15ce3-25dd-4b27-835c-709ef427055c service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:27.751760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15ce3-25dd-4b27-835c-709ef427055c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:27.766275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15ce3-25dd-4b27-835c-709ef427055c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:27.768534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15ce3-25dd-4b27-835c-709ef427055c service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:27.780265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 872/1744] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:27.823895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 873/1745] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:27 2022] POST /identity/v3/users => generated 295 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:27.828480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15ce3-25dd-4b27-835c-709ef427055c service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:27.848674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15ce3-25dd-4b27-835c-709ef427055c service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:27.863434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0bda0-830f-427d-9f94-0b7cf91006f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:27.864442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0bda0-830f-427d-9f94-0b7cf91006f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:27.865028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0bda0-830f-427d-9f94-0b7cf91006f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:27.867162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0bda0-830f-427d-9f94-0b7cf91006f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:27.868425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0bda0-830f-427d-9f94-0b7cf91006f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:27.871119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0bda0-830f-427d-9f94-0b7cf91006f1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:27.887537 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 873/1746] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:27.892106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2c49-3b05-4093-83fd-f2a650f79dc2 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:27.908410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2c49-3b05-4093-83fd-f2a650f79dc2 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:27.920507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c63a7-a025-4a93-a2a5-2bde0e059c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:27.922206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c63a7-a025-4a93-a2a5-2bde0e059c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:27.922557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c63a7-a025-4a93-a2a5-2bde0e059c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:27.923098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c63a7-a025-4a93-a2a5-2bde0e059c7b admin admin] PATH_INFO: `/v3/projects/f83f0cbf1fba4ff8a93e2326261a1d98/users/ae8cf292032d4afba4f9edabd8b6b523/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:27.972695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c63a7-a025-4a93-a2a5-2bde0e059c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83f0cbf1fba4ff8a93e2326261a1d98, user_id=ae8cf292032d4afba4f9edabd8b6b523, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:27.978758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c63a7-a025-4a93-a2a5-2bde0e059c7b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:28.044867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:28.121757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 874/1747] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:27 2022] PUT /identity/v3/projects/f83f0cbf1fba4ff8a93e2326261a1d98/users/ae8cf292032d4afba4f9edabd8b6b523/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:28.127215 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0bda0-830f-427d-9f94-0b7cf91006f1 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:28.149342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0bda0-830f-427d-9f94-0b7cf91006f1 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:28.268097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6bad-5db0-4d0a-8802-1801aedb456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:28.268794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6bad-5db0-4d0a-8802-1801aedb456e admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:28.269081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6bad-5db0-4d0a-8802-1801aedb456e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:28.269356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6bad-5db0-4d0a-8802-1801aedb456e admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:28.270087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d6bad-5db0-4d0a-8802-1801aedb456e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:28.271806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d6bad-5db0-4d0a-8802-1801aedb456e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:28.294178 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 874/1748] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:28.294342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c63a7-a025-4a93-a2a5-2bde0e059c7b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:28.308033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c63a7-a025-4a93-a2a5-2bde0e059c7b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:28.314743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c108df-d3f3-4f7a-9459-20c30332319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:28.316429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c108df-d3f3-4f7a-9459-20c30332319f admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:28.317416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c108df-d3f3-4f7a-9459-20c30332319f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:28.318303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c108df-d3f3-4f7a-9459-20c30332319f admin admin] PATH_INFO: `/v3/projects/f83f0cbf1fba4ff8a93e2326261a1d98/users/ae8cf292032d4afba4f9edabd8b6b523/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:28.325535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c108df-d3f3-4f7a-9459-20c30332319f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83f0cbf1fba4ff8a93e2326261a1d98, user_id=ae8cf292032d4afba4f9edabd8b6b523, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:28.360804 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c108df-d3f3-4f7a-9459-20c30332319f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:28.409041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0564de7-7b57-4529-9967-533dcfacce47 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:28.409196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 875/1749] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:28 2022] PUT /identity/v3/projects/f83f0cbf1fba4ff8a93e2326261a1d98/users/ae8cf292032d4afba4f9edabd8b6b523/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:28.409386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0564de7-7b57-4529-9967-533dcfacce47 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:28.409778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0564de7-7b57-4529-9967-533dcfacce47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:28.525517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c0564de7-7b57-4529-9967-533dcfacce47 None None] MFA Rules not processed for user `ae8cf292032d4afba4f9edabd8b6b523`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:28.527429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c0564de7-7b57-4529-9967-533dcfacce47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:28.671077 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 875/1750] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:28.693912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c108df-d3f3-4f7a-9459-20c30332319f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:28.825655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c108df-d3f3-4f7a-9459-20c30332319f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:28.830187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a4726-31a5-45fe-ab64-6fc6c4a6fbce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:28.831050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a4726-31a5-45fe-ab64-6fc6c4a6fbce service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:28.831501 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a4726-31a5-45fe-ab64-6fc6c4a6fbce service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:28.831971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a4726-31a5-45fe-ab64-6fc6c4a6fbce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:28.938870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a4726-31a5-45fe-ab64-6fc6c4a6fbce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:28.943255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a4726-31a5-45fe-ab64-6fc6c4a6fbce service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:28.974743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 876/1751] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:29.896107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946fb4-a96c-496f-a674-a31c124e1edb None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:29.897087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946fb4-a96c-496f-a674-a31c124e1edb None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:29.897570 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946fb4-a96c-496f-a674-a31c124e1edb None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:29.902047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 876/1752] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:40:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:29.911643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbccb9-93ce-4e57-9609-e4eb6e3ab3f6 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:29.912230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbccb9-93ce-4e57-9609-e4eb6e3ab3f6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:29.913202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbccb9-93ce-4e57-9609-e4eb6e3ab3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:29.950759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-1ccbccb9-93ce-4e57-9609-e4eb6e3ab3f6 None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:29.952363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1ccbccb9-93ce-4e57-9609-e4eb6e3ab3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:30.090046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 877/1753] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:40:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:30.106814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946fb4-a96c-496f-a674-a31c124e1edb None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:30.111930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0c946fb4-a96c-496f-a674-a31c124e1edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:30.171401 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946fb4-a96c-496f-a674-a31c124e1edb None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:30.182848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b111c5-bf82-4127-879a-d6380d7c2d05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:30.183600 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b111c5-bf82-4127-879a-d6380d7c2d05 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:30.183902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b111c5-bf82-4127-879a-d6380d7c2d05 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:30.184094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b111c5-bf82-4127-879a-d6380d7c2d05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:30.199800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b111c5-bf82-4127-879a-d6380d7c2d05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:30.203646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b111c5-bf82-4127-879a-d6380d7c2d05 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:30.235868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 877/1754] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:31.580765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:32.012443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cc914-d1db-4455-984b-df411aac0b3f None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:32.013207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cc914-d1db-4455-984b-df411aac0b3f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:32.013672 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cc914-d1db-4455-984b-df411aac0b3f None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:32.015704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 878/1755] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:32.031545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c43fb-baa2-4ced-8237-49ee9b4522be None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:32.031896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c43fb-baa2-4ced-8237-49ee9b4522be None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:32.032202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c43fb-baa2-4ced-8237-49ee9b4522be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:32.067019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-583c43fb-baa2-4ced-8237-49ee9b4522be None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:32.068515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-583c43fb-baa2-4ced-8237-49ee9b4522be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:32.107952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 878/1756] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:40:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:32.152699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cc914-d1db-4455-984b-df411aac0b3f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:32.186471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cc914-d1db-4455-984b-df411aac0b3f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:32.221590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03fdb-ca97-4e12-9bfb-37771d6e62cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:32.222552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03fdb-ca97-4e12-9bfb-37771d6e62cf service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:32.224885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03fdb-ca97-4e12-9bfb-37771d6e62cf service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:32.225510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03fdb-ca97-4e12-9bfb-37771d6e62cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:32.276982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d03fdb-ca97-4e12-9bfb-37771d6e62cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:32.278895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d03fdb-ca97-4e12-9bfb-37771d6e62cf service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:32.325057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 879/1757] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:33.080250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:33.679035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c43fb-baa2-4ced-8237-49ee9b4522be None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:33.681052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-583c43fb-baa2-4ced-8237-49ee9b4522be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:33.699333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c43fb-baa2-4ced-8237-49ee9b4522be None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:33.725236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88b2b1-d605-4f8b-ac1f-1d03c84504b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:33.725982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88b2b1-d605-4f8b-ac1f-1d03c84504b2 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:33.726215 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88b2b1-d605-4f8b-ac1f-1d03c84504b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:33.726498 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88b2b1-d605-4f8b-ac1f-1d03c84504b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:33.775219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88b2b1-d605-4f8b-ac1f-1d03c84504b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:33.777652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88b2b1-d605-4f8b-ac1f-1d03c84504b2 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:33.818977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 879/1758] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:34.873348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:35.105204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03fdb-ca97-4e12-9bfb-37771d6e62cf service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:35.107080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f5d03fdb-ca97-4e12-9bfb-37771d6e62cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:35.195676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03fdb-ca97-4e12-9bfb-37771d6e62cf service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:35.204241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:35.205510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:35.205948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:35.206545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] PATH_INFO: `/v3/users/884e7c490d204a928a493e8abf0ca0cc` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:35.208295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=884e7c490d204a928a493e8abf0ca0cc)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:35.211134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:35.490510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884e7c490d204a928a493e8abf0ca0cc'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:35.491208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884e7c490d204a928a493e8abf0ca0cc'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:35.506637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884e7c490d204a928a493e8abf0ca0cc'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:35.594042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884e7c490d204a928a493e8abf0ca0cc'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:35.608646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884e7c490d204a928a493e8abf0ca0cc'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:35.614942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 880/1759] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:35 2022] DELETE /identity/v3/users/884e7c490d204a928a493e8abf0ca0cc => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:35.619475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322ee52-f847-4a93-8a6c-d0b891b69728 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:35.621801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322ee52-f847-4a93-8a6c-d0b891b69728 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:35.621801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322ee52-f847-4a93-8a6c-d0b891b69728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:35.640272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c322ee52-f847-4a93-8a6c-d0b891b69728 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:35.642009 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c322ee52-f847-4a93-8a6c-d0b891b69728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:35.715763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 880/1760] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:35.725029 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:35.726582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:35.916154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04bc35-3cc6-4522-8636-ef6e850b2c6b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:35.920546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d62908-77c3-452d-a228-96a04b7ad111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:35.921201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d62908-77c3-452d-a228-96a04b7ad111 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:35.921482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d62908-77c3-452d-a228-96a04b7ad111 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:35.921902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d62908-77c3-452d-a228-96a04b7ad111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:35.932512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d62908-77c3-452d-a228-96a04b7ad111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:35.934156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d62908-77c3-452d-a228-96a04b7ad111 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:35.945865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 881/1761] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:36.264495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:36.431057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322ee52-f847-4a93-8a6c-d0b891b69728 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:36.432509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c322ee52-f847-4a93-8a6c-d0b891b69728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:36.444241 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322ee52-f847-4a93-8a6c-d0b891b69728 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:36.449616 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:36.450481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:36.450765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:36.451044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] PATH_INFO: `/v3/projects/03ddb49f3aca49e59c2baceb85a01102` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:36.452242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ddb49f3aca49e59c2baceb85a01102)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:36.454201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:36.633059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ddb49f3aca49e59c2baceb85a01102', 'request_id': 'req-9348e0d3-75be-4b7f-96e1-00517a85fd18'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:36.641163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ddb49f3aca49e59c2baceb85a01102', 'request_id': 'req-9348e0d3-75be-4b7f-96e1-00517a85fd18'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:36.748232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ddb49f3aca49e59c2baceb85a01102', 'request_id': 'req-9348e0d3-75be-4b7f-96e1-00517a85fd18'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:36.759223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] The token cache is being invalidate because project 03ddb49f3aca49e59c2baceb85a01102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:36.759507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:36.760803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:36.762607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 881/1762] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:36 2022] DELETE /identity/v3/projects/03ddb49f3aca49e59c2baceb85a01102 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:36.766768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d62908-77c3-452d-a228-96a04b7ad111 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:36.776028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d62908-77c3-452d-a228-96a04b7ad111 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:36.836881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:36.843911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:36.843911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:36.843911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] PATH_INFO: `/v3/users/b625c91ff8854234970dddcdc7f1a98f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:36.843911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b625c91ff8854234970dddcdc7f1a98f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:36.843911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:37.049557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b625c91ff8854234970dddcdc7f1a98f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:37.050263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b625c91ff8854234970dddcdc7f1a98f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:37.058443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b625c91ff8854234970dddcdc7f1a98f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:37.072994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:37.154110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b625c91ff8854234970dddcdc7f1a98f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:37.178861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-64a18f7a-afef-4827-bf70-db72e13c8ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b625c91ff8854234970dddcdc7f1a98f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:37.198372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 882/1763] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:36 2022] DELETE /identity/v3/users/b625c91ff8854234970dddcdc7f1a98f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:37.726676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:37.728048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:37.751075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348e0d3-75be-4b7f-96e1-00517a85fd18 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:37.806540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:37.807446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:37.807781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:37.808069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] PATH_INFO: `/v3/projects/7d340cf304f34f9d812c5c6c9d1fa1e8` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:37.809230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d340cf304f34f9d812c5c6c9d1fa1e8)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:37.811136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:37.959861 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d340cf304f34f9d812c5c6c9d1fa1e8', 'request_id': 'req-eebaf59e-454d-4cdd-949b-8538dace3dc3'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:37.966771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d340cf304f34f9d812c5c6c9d1fa1e8', 'request_id': 'req-eebaf59e-454d-4cdd-949b-8538dace3dc3'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:38.062670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d340cf304f34f9d812c5c6c9d1fa1e8', 'request_id': 'req-eebaf59e-454d-4cdd-949b-8538dace3dc3'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:38.094106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] The token cache is being invalidate because project 7d340cf304f34f9d812c5c6c9d1fa1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:38.094892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:38.097237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-eebaf59e-454d-4cdd-949b-8538dace3dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:38.102979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 882/1764] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:37 2022] DELETE /identity/v3/projects/7d340cf304f34f9d812c5c6c9d1fa1e8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:38.112087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2efc43-4a2f-4050-b8d5-c879409f0c8b None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:38.112614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2efc43-4a2f-4050-b8d5-c879409f0c8b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:38.112712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2efc43-4a2f-4050-b8d5-c879409f0c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:38.144180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-6a2efc43-4a2f-4050-b8d5-c879409f0c8b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:38.144180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-6a2efc43-4a2f-4050-b8d5-c879409f0c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:38.218716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 883/1765] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:38.225799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:38.227282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8c88a-cd01-4018-8998-61c6e6c13da0 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:38.227628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8c88a-cd01-4018-8998-61c6e6c13da0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:38.228301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8c88a-cd01-4018-8998-61c6e6c13da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:38.258405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-21b8c88a-cd01-4018-8998-61c6e6c13da0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:38.259933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-21b8c88a-cd01-4018-8998-61c6e6c13da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:38.286445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 883/1766] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:38.292112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2efc43-4a2f-4050-b8d5-c879409f0c8b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:38.302154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2efc43-4a2f-4050-b8d5-c879409f0c8b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:38.308314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab802888-527d-4a44-afcb-ded04f5538e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:38.309177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802888-527d-4a44-afcb-ded04f5538e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:38.309621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802888-527d-4a44-afcb-ded04f5538e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:38.310065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802888-527d-4a44-afcb-ded04f5538e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:38.310944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab802888-527d-4a44-afcb-ded04f5538e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:40:38.311415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab802888-527d-4a44-afcb-ded04f5538e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:38.313444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab802888-527d-4a44-afcb-ded04f5538e2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:38.327285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 884/1767] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:40:38.332093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8c88a-cd01-4018-8998-61c6e6c13da0 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:38.341736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8c88a-cd01-4018-8998-61c6e6c13da0 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:38.346712 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479442ed-444b-4890-947b-c3596e178cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:38.354523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479442ed-444b-4890-947b-c3596e178cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:38.356147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479442ed-444b-4890-947b-c3596e178cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:38.357942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479442ed-444b-4890-947b-c3596e178cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:38.357942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479442ed-444b-4890-947b-c3596e178cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:38.360015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479442ed-444b-4890-947b-c3596e178cf0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:38.518224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 884/1768] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:38 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:38.522707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab802888-527d-4a44-afcb-ded04f5538e2 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:38.532786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab802888-527d-4a44-afcb-ded04f5538e2 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:38.577754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:38.591873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bbeaf-47f3-4ad5-879a-80fab222f4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:38.593005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bbeaf-47f3-4ad5-879a-80fab222f4ed admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:38.593384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bbeaf-47f3-4ad5-879a-80fab222f4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:38.593757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bbeaf-47f3-4ad5-879a-80fab222f4ed admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:38.594546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bbeaf-47f3-4ad5-879a-80fab222f4ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:38.596547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bbeaf-47f3-4ad5-879a-80fab222f4ed admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:38.731242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 885/1769] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:38 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:38.732461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479442ed-444b-4890-947b-c3596e178cf0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:38.743464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479442ed-444b-4890-947b-c3596e178cf0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:38.749892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eceea-f7c2-4a0e-bcef-aef8e792c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:38.750597 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eceea-f7c2-4a0e-bcef-aef8e792c623 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:38.750884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eceea-f7c2-4a0e-bcef-aef8e792c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:38.751163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eceea-f7c2-4a0e-bcef-aef8e792c623 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:38.752058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eceea-f7c2-4a0e-bcef-aef8e792c623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:38.753708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eceea-f7c2-4a0e-bcef-aef8e792c623 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:38.766839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 885/1770] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:38.770521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bbeaf-47f3-4ad5-879a-80fab222f4ed admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:38.782768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bbeaf-47f3-4ad5-879a-80fab222f4ed admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:38.791051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881b863-f966-4bf5-9191-83b8f6ea31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:38.792961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881b863-f966-4bf5-9191-83b8f6ea31a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:38.793690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881b863-f966-4bf5-9191-83b8f6ea31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:38.794175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881b863-f966-4bf5-9191-83b8f6ea31a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:38.795129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881b863-f966-4bf5-9191-83b8f6ea31a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:38.797182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881b863-f966-4bf5-9191-83b8f6ea31a5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:38.818409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 886/1771] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:40:38.819690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eceea-f7c2-4a0e-bcef-aef8e792c623 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:38.852949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eceea-f7c2-4a0e-bcef-aef8e792c623 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:38.865286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e079d-9543-4f68-9c16-5e090c06d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:38.867631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e079d-9543-4f68-9c16-5e090c06d2da admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:38.871649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e079d-9543-4f68-9c16-5e090c06d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:38.872239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e079d-9543-4f68-9c16-5e090c06d2da admin admin] PATH_INFO: `/v3/projects/d3a010d31c1948ebabe738cf63c57613/users/1a9ef0fcbcec4b5da1b0257d8c15f6dc/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:38.902205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e079d-9543-4f68-9c16-5e090c06d2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a010d31c1948ebabe738cf63c57613, user_id=1a9ef0fcbcec4b5da1b0257d8c15f6dc, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:38.905224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e079d-9543-4f68-9c16-5e090c06d2da admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:39.010609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 886/1772] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:38 2022] PUT /identity/v3/projects/d3a010d31c1948ebabe738cf63c57613/users/1a9ef0fcbcec4b5da1b0257d8c15f6dc/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:39.021005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2105d-c192-4257-8810-e9335684c61e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:39.021387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2105d-c192-4257-8810-e9335684c61e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:39.021540 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2105d-c192-4257-8810-e9335684c61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:39.073596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-edd2105d-c192-4257-8810-e9335684c61e None None] MFA Rules not processed for user `1a9ef0fcbcec4b5da1b0257d8c15f6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:39.075644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-edd2105d-c192-4257-8810-e9335684c61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:39.196706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 887/1773] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:39.201550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e079d-9543-4f68-9c16-5e090c06d2da admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:39.412133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e079d-9543-4f68-9c16-5e090c06d2da admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:39.434698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cfdbf-356d-4a93-9478-97452772bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:39.435584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cfdbf-356d-4a93-9478-97452772bc62 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:39.436287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cfdbf-356d-4a93-9478-97452772bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:39.436760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cfdbf-356d-4a93-9478-97452772bc62 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:39.437482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cfdbf-356d-4a93-9478-97452772bc62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:39.445493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cfdbf-356d-4a93-9478-97452772bc62 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:40.194748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 887/1774] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:39 2022] POST /identity/v3/projects => generated 381 bytes in 994 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:40.200795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2105d-c192-4257-8810-e9335684c61e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:40.215710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2105d-c192-4257-8810-e9335684c61e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:40.300709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd6a4b-eccc-457f-9848-40a2d190a2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:40.301739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6a4b-eccc-457f-9848-40a2d190a2dd admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:40.302184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6a4b-eccc-457f-9848-40a2d190a2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:40.302464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd6a4b-eccc-457f-9848-40a2d190a2dd admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:40.303180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd6a4b-eccc-457f-9848-40a2d190a2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:40.305182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd6a4b-eccc-457f-9848-40a2d190a2dd admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:40.547010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 888/1775] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:40 2022] POST /identity/v3/users => generated 297 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:40.548319 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cfdbf-356d-4a93-9478-97452772bc62 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:40.558846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cfdbf-356d-4a93-9478-97452772bc62 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:40.563444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780c705-800d-4190-87e0-66b3b1a1a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:40.564157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780c705-800d-4190-87e0-66b3b1a1a3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:40.564446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780c705-800d-4190-87e0-66b3b1a1a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:40.564728 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780c705-800d-4190-87e0-66b3b1a1a3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:40.565445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780c705-800d-4190-87e0-66b3b1a1a3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:40.567053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780c705-800d-4190-87e0-66b3b1a1a3b5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:40.577941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 888/1776] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:40.582106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd6a4b-eccc-457f-9848-40a2d190a2dd admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:40.593350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd6a4b-eccc-457f-9848-40a2d190a2dd admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:40.599154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b61b49-85a7-4210-afa5-530acb686279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:40.600166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b61b49-85a7-4210-afa5-530acb686279 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:40.600552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b61b49-85a7-4210-afa5-530acb686279 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:40.600861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b61b49-85a7-4210-afa5-530acb686279 admin admin] PATH_INFO: `/v3/projects/236e93a5b38d40c79c627d04ecfc2915/users/453fdf889a264086ba724c52f3651d50/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:40.620680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b61b49-85a7-4210-afa5-530acb686279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236e93a5b38d40c79c627d04ecfc2915, user_id=453fdf889a264086ba724c52f3651d50, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:40.623955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b61b49-85a7-4210-afa5-530acb686279 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:40.768530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa8b0d-df79-4dde-9725-08a1992dacfc None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:40.768819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa8b0d-df79-4dde-9725-08a1992dacfc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:40.769187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa8b0d-df79-4dde-9725-08a1992dacfc None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:40.770632 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 889/1777] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:40:40.772542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 889/1778] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:40 2022] PUT /identity/v3/projects/236e93a5b38d40c79c627d04ecfc2915/users/453fdf889a264086ba724c52f3651d50/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:40.780031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa8b0d-df79-4dde-9725-08a1992dacfc None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:40.781022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571aa5-a3cd-4b85-8cfb-73a21b29f4c4 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:40.781475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571aa5-a3cd-4b85-8cfb-73a21b29f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:40.781945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571aa5-a3cd-4b85-8cfb-73a21b29f4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:40.825543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-36571aa5-a3cd-4b85-8cfb-73a21b29f4c4 None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:40.827283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-36571aa5-a3cd-4b85-8cfb-73a21b29f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:40.859447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa8b0d-df79-4dde-9725-08a1992dacfc None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:40.864934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c4d80-ef95-46ca-81fb-50fbc0b9e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:40.865933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c4d80-ef95-46ca-81fb-50fbc0b9e166 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:40.866531 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c4d80-ef95-46ca-81fb-50fbc0b9e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:40.867447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c4d80-ef95-46ca-81fb-50fbc0b9e166 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:40.868836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c4d80-ef95-46ca-81fb-50fbc0b9e166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:40.871569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c4d80-ef95-46ca-81fb-50fbc0b9e166 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:40.885547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 890/1779] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:40.889655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c4d80-ef95-46ca-81fb-50fbc0b9e166 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:40.903580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c4d80-ef95-46ca-81fb-50fbc0b9e166 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:40.910644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab44b4-741d-4b45-a3ea-f8bdea5a9a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:40.912067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab44b4-741d-4b45-a3ea-f8bdea5a9a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:40.912640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab44b4-741d-4b45-a3ea-f8bdea5a9a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:40.918376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab44b4-741d-4b45-a3ea-f8bdea5a9a7a admin admin] PATH_INFO: `/v3/projects/236e93a5b38d40c79c627d04ecfc2915/users/453fdf889a264086ba724c52f3651d50/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:40.918376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab44b4-741d-4b45-a3ea-f8bdea5a9a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=236e93a5b38d40c79c627d04ecfc2915, user_id=453fdf889a264086ba724c52f3651d50, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:40.919674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab44b4-741d-4b45-a3ea-f8bdea5a9a7a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:40.941448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 891/1780] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:40 2022] PUT /identity/v3/projects/236e93a5b38d40c79c627d04ecfc2915/users/453fdf889a264086ba724c52f3651d50/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:40.951600 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b692d-aeff-4030-9f46-713cf9f8057b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:40.952321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b692d-aeff-4030-9f46-713cf9f8057b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:40.952771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b692d-aeff-4030-9f46-713cf9f8057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:40.974369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 890/1781] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:40:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:40.990419 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-763b692d-aeff-4030-9f46-713cf9f8057b None None] MFA Rules not processed for user `453fdf889a264086ba724c52f3651d50`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:40.991672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-763b692d-aeff-4030-9f46-713cf9f8057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:41.002016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571aa5-a3cd-4b85-8cfb-73a21b29f4c4 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:41.005032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-36571aa5-a3cd-4b85-8cfb-73a21b29f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:41.018180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571aa5-a3cd-4b85-8cfb-73a21b29f4c4 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:41.125488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 892/1782] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:41.125579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fd42f-8bf7-4df5-b70f-605eadcf347b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:41.125579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fd42f-8bf7-4df5-b70f-605eadcf347b service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:41.125579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fd42f-8bf7-4df5-b70f-605eadcf347b service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:41.125579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fd42f-8bf7-4df5-b70f-605eadcf347b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:41.130738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fd42f-8bf7-4df5-b70f-605eadcf347b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:41.132362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fd42f-8bf7-4df5-b70f-605eadcf347b service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:41.140346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b692d-aeff-4030-9f46-713cf9f8057b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:41.143113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-763b692d-aeff-4030-9f46-713cf9f8057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:41.154388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 891/1783] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:40:41.218092 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b692d-aeff-4030-9f46-713cf9f8057b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:41.221811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446ddab-1c38-4a5a-8da0-13d275d3aa00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:41.222466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ddab-1c38-4a5a-8da0-13d275d3aa00 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:41.222753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ddab-1c38-4a5a-8da0-13d275d3aa00 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:41.223035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ddab-1c38-4a5a-8da0-13d275d3aa00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:41.233519 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446ddab-1c38-4a5a-8da0-13d275d3aa00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:41.235114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446ddab-1c38-4a5a-8da0-13d275d3aa00 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:41.245084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 893/1784] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:40:41.404522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fd42f-8bf7-4df5-b70f-605eadcf347b service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:41.406211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fe6fd42f-8bf7-4df5-b70f-605eadcf347b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:41.419690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fd42f-8bf7-4df5-b70f-605eadcf347b service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:41.423564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae893d5-5297-4eff-8ef0-b5c4edcb35c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:41.424336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae893d5-5297-4eff-8ef0-b5c4edcb35c4 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:41.424700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae893d5-5297-4eff-8ef0-b5c4edcb35c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:41.425050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae893d5-5297-4eff-8ef0-b5c4edcb35c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:41.490704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae893d5-5297-4eff-8ef0-b5c4edcb35c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:41.492228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae893d5-5297-4eff-8ef0-b5c4edcb35c4 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:41.501960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 892/1785] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:41.865516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:43.879946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:44.831251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:46.308442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446ddab-1c38-4a5a-8da0-13d275d3aa00 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:46.385343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446ddab-1c38-4a5a-8da0-13d275d3aa00 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:46.391603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:46.392739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:46.393252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:46.394476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] PATH_INFO: `/v3/users/1a9ef0fcbcec4b5da1b0257d8c15f6dc` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:46.396966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9ef0fcbcec4b5da1b0257d8c15f6dc)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:46.399293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:46.700614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9ef0fcbcec4b5da1b0257d8c15f6dc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:46.701387 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9ef0fcbcec4b5da1b0257d8c15f6dc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:46.822938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9ef0fcbcec4b5da1b0257d8c15f6dc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:46.830810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9ef0fcbcec4b5da1b0257d8c15f6dc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:46.843949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9ef0fcbcec4b5da1b0257d8c15f6dc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:46.850787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 894/1786] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:46 2022] DELETE /identity/v3/users/1a9ef0fcbcec4b5da1b0257d8c15f6dc => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:46.856333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89341-1f77-46fd-978e-f6af2f858831 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:46.856789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89341-1f77-46fd-978e-f6af2f858831 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:46.856916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89341-1f77-46fd-978e-f6af2f858831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:46.891279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e4f89341-1f77-46fd-978e-f6af2f858831 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:46.893062 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e4f89341-1f77-46fd-978e-f6af2f858831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:46.897422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:46.966804 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 893/1787] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:46.976428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:46.977846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:47.043575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846ca51-98f9-487c-a1dc-d7830f8de4ad admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:47.047254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a684d-5d61-424d-b2a4-b43c0f40251c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:47.047934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a684d-5d61-424d-b2a4-b43c0f40251c service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:47.048247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a684d-5d61-424d-b2a4-b43c0f40251c service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:47.048521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a684d-5d61-424d-b2a4-b43c0f40251c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:47.058224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a684d-5d61-424d-b2a4-b43c0f40251c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:47.059711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a684d-5d61-424d-b2a4-b43c0f40251c service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:47.069490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 895/1788] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:47.722618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f89341-1f77-46fd-978e-f6af2f858831 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:47.724041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e4f89341-1f77-46fd-978e-f6af2f858831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:47.736065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f89341-1f77-46fd-978e-f6af2f858831 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:47.740934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:47.741828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:47.742108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:47.742382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] PATH_INFO: `/v3/projects/d3a010d31c1948ebabe738cf63c57613` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:47.743560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a010d31c1948ebabe738cf63c57613)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:47.746475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:47.959948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a010d31c1948ebabe738cf63c57613', 'request_id': 'req-62a37688-06cb-4b96-b24a-d0d756f869ae'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:47.965311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a010d31c1948ebabe738cf63c57613', 'request_id': 'req-62a37688-06cb-4b96-b24a-d0d756f869ae'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:47.971779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a010d31c1948ebabe738cf63c57613', 'request_id': 'req-62a37688-06cb-4b96-b24a-d0d756f869ae'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:48.095541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] The token cache is being invalidate because project d3a010d31c1948ebabe738cf63c57613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:48.096210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:48.097089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:48.098813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 894/1789] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:47 2022] DELETE /identity/v3/projects/d3a010d31c1948ebabe738cf63c57613 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:48.103040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a684d-5d61-424d-b2a4-b43c0f40251c service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:48.113591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a684d-5d61-424d-b2a4-b43c0f40251c service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:48.174939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:48.175711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:48.176025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:48.176302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] PATH_INFO: `/v3/users/453fdf889a264086ba724c52f3651d50` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:48.177529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=453fdf889a264086ba724c52f3651d50)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:48.179444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:48.205123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:48.447969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453fdf889a264086ba724c52f3651d50'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:48.448959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453fdf889a264086ba724c52f3651d50'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:48.600668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:48.602787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453fdf889a264086ba724c52f3651d50'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:48.611351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453fdf889a264086ba724c52f3651d50'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:48.624806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4598cbfb-ce4a-400a-a2da-c7a8537f40dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453fdf889a264086ba724c52f3651d50'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:48.635428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 896/1790] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:48 2022] DELETE /identity/v3/users/453fdf889a264086ba724c52f3651d50 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:49.206497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:49.209292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:49.254953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37688-06cb-4b96-b24a-d0d756f869ae admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:49.329443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:49.330314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:49.330598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:49.330876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] PATH_INFO: `/v3/projects/236e93a5b38d40c79c627d04ecfc2915` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:49.332289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] RBAC: Authorizing `identity:delete_project(project_id=236e93a5b38d40c79c627d04ecfc2915)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:49.334242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:49.504095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236e93a5b38d40c79c627d04ecfc2915', 'request_id': 'req-c6b252d6-bc33-43fb-baa5-bdb557fb845d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:49.512042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236e93a5b38d40c79c627d04ecfc2915', 'request_id': 'req-c6b252d6-bc33-43fb-baa5-bdb557fb845d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:49.519257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236e93a5b38d40c79c627d04ecfc2915', 'request_id': 'req-c6b252d6-bc33-43fb-baa5-bdb557fb845d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:49.666532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] The token cache is being invalidate because project 236e93a5b38d40c79c627d04ecfc2915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:49.666948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:49.668095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c6b252d6-bc33-43fb-baa5-bdb557fb845d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:49.673873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 895/1791] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:49 2022] DELETE /identity/v3/projects/236e93a5b38d40c79c627d04ecfc2915 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:49.680772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc935e7e-d4af-4b35-9c9a-8663ace74160 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:49.681759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc935e7e-d4af-4b35-9c9a-8663ace74160 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:49.682206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc935e7e-d4af-4b35-9c9a-8663ace74160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:49.707887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-bc935e7e-d4af-4b35-9c9a-8663ace74160 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:49.709522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-bc935e7e-d4af-4b35-9c9a-8663ace74160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:49.784056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 897/1792] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:49.792897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd519-d6f0-4f73-9a2a-15b96ed2a0d3 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:49.795470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd519-d6f0-4f73-9a2a-15b96ed2a0d3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:49.795470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd519-d6f0-4f73-9a2a-15b96ed2a0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:49.818089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-17afd519-d6f0-4f73-9a2a-15b96ed2a0d3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:49.819433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-17afd519-d6f0-4f73-9a2a-15b96ed2a0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:49.829935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 896/1793] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:49.834037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc935e7e-d4af-4b35-9c9a-8663ace74160 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:49.846312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc935e7e-d4af-4b35-9c9a-8663ace74160 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:49.857685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f869-6255-4af5-a011-62f78711e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:49.858491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f869-6255-4af5-a011-62f78711e020 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:49.858847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f869-6255-4af5-a011-62f78711e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:49.859203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f869-6255-4af5-a011-62f78711e020 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:49.860086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1f869-6255-4af5-a011-62f78711e020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:40:49.860478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1f869-6255-4af5-a011-62f78711e020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:49.862298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1f869-6255-4af5-a011-62f78711e020 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:49.904412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 898/1794] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:40:49.908611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd519-d6f0-4f73-9a2a-15b96ed2a0d3 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:49.920643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd519-d6f0-4f73-9a2a-15b96ed2a0d3 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:49.926433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1746669-a981-4b78-853e-de08845a4d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:49.927356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1746669-a981-4b78-853e-de08845a4d40 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:49.927901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1746669-a981-4b78-853e-de08845a4d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:49.928505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1746669-a981-4b78-853e-de08845a4d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:49.929424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1746669-a981-4b78-853e-de08845a4d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:49.931852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1746669-a981-4b78-853e-de08845a4d40 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:50.105880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 897/1795] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:49 2022] POST /identity/v3/projects => generated 359 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:50.107300 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f869-6255-4af5-a011-62f78711e020 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:50.116923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f869-6255-4af5-a011-62f78711e020 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:50.184094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77bc83-0a82-49a9-8bdc-347781080a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:50.184854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77bc83-0a82-49a9-8bdc-347781080a02 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:50.185218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77bc83-0a82-49a9-8bdc-347781080a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:50.185605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77bc83-0a82-49a9-8bdc-347781080a02 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:50.186370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77bc83-0a82-49a9-8bdc-347781080a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:50.188451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77bc83-0a82-49a9-8bdc-347781080a02 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:50.330763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 899/1796] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:50 2022] POST /identity/v3/users => generated 280 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:50.335352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1746669-a981-4b78-853e-de08845a4d40 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:50.349726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1746669-a981-4b78-853e-de08845a4d40 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:50.361437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acb3e8-e6a9-4964-8828-cbb448fc66ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:50.361658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77bc83-0a82-49a9-8bdc-347781080a02 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:50.362757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acb3e8-e6a9-4964-8828-cbb448fc66ee admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:50.363229 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acb3e8-e6a9-4964-8828-cbb448fc66ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:50.363699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1a77bc83-0a82-49a9-8bdc-347781080a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:50.364016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acb3e8-e6a9-4964-8828-cbb448fc66ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:50.365108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acb3e8-e6a9-4964-8828-cbb448fc66ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:50.367899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acb3e8-e6a9-4964-8828-cbb448fc66ee admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:50.380911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77bc83-0a82-49a9-8bdc-347781080a02 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:50.387802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:50.395878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:50.396140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 898/1797] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:50.396237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:50.396237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] PATH_INFO: `/v3/users/de0b851b8c664010a0aadea6cf542943` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:50.396379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acb3e8-e6a9-4964-8828-cbb448fc66ee admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:50.396446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0b851b8c664010a0aadea6cf542943)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:50.396446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:50.407105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acb3e8-e6a9-4964-8828-cbb448fc66ee admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:50.412585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13d1dd-714a-46a6-bbf1-2197fa790a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:50.413687 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13d1dd-714a-46a6-bbf1-2197fa790a75 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:50.414299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13d1dd-714a-46a6-bbf1-2197fa790a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:50.414730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13d1dd-714a-46a6-bbf1-2197fa790a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:50.416026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13d1dd-714a-46a6-bbf1-2197fa790a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:50.418113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13d1dd-714a-46a6-bbf1-2197fa790a75 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:50.430743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 899/1798] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:50.435503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13d1dd-714a-46a6-bbf1-2197fa790a75 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:50.449425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13d1dd-714a-46a6-bbf1-2197fa790a75 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:50.455441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afb399-e132-4756-ad74-ca22010e9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:50.456403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afb399-e132-4756-ad74-ca22010e9d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:50.456893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afb399-e132-4756-ad74-ca22010e9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:50.457173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afb399-e132-4756-ad74-ca22010e9d60 admin admin] PATH_INFO: `/v3/projects/8379c024098d4ed29c6e1a2063d98143/users/e76ba796f18b412f9bf422c206577c8d/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:50.480770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afb399-e132-4756-ad74-ca22010e9d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8379c024098d4ed29c6e1a2063d98143, user_id=e76ba796f18b412f9bf422c206577c8d, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:50.484220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afb399-e132-4756-ad74-ca22010e9d60 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:50.595134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 900/1799] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:50 2022] PUT /identity/v3/projects/8379c024098d4ed29c6e1a2063d98143/users/e76ba796f18b412f9bf422c206577c8d/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:50.606559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d5a6-b036-49b0-9056-bf204538e955 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:50.606854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d5a6-b036-49b0-9056-bf204538e955 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:50.607137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d5a6-b036-49b0-9056-bf204538e955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:50.637517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7467d5a6-b036-49b0-9056-bf204538e955 None None] MFA Rules not processed for user `e76ba796f18b412f9bf422c206577c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:50.638767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7467d5a6-b036-49b0-9056-bf204538e955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:50.682732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0b851b8c664010a0aadea6cf542943'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:50.687634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0b851b8c664010a0aadea6cf542943'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:50.727550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 901/1800] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:50 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:50.808843 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0b851b8c664010a0aadea6cf542943'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:50.861112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0b851b8c664010a0aadea6cf542943'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:50.901811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0b851b8c664010a0aadea6cf542943'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:50.914303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:50.934667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 900/1801] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:50 2022] DELETE /identity/v3/users/de0b851b8c664010a0aadea6cf542943 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:50.934754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2712e8-4228-47bf-a845-5eed6e01bb90 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:50.934754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2712e8-4228-47bf-a845-5eed6e01bb90 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:50.934754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2712e8-4228-47bf-a845-5eed6e01bb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:50.950507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:50.956930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:50.985760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-fd2712e8-4228-47bf-a845-5eed6e01bb90 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:50.990874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fd2712e8-4228-47bf-a845-5eed6e01bb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:51.051444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07714f-c1aa-4acd-bb9f-c0d9ab894186 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:51.066419 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:51.067283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:51.067673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:51.068101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:51.070174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:51.121202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 902/1802] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:51.132076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2712e8-4228-47bf-a845-5eed6e01bb90 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:51.133811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fd2712e8-4228-47bf-a845-5eed6e01bb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:51.161345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:51.164613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:51.178453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 901/1803] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:50 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:40:51.194254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:51.195899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:51.217449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2712e8-4228-47bf-a845-5eed6e01bb90 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:51.221924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fee75f-9dcf-4e5b-96fc-c5f82aaecfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:51.222586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fee75f-9dcf-4e5b-96fc-c5f82aaecfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:51.222866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fee75f-9dcf-4e5b-96fc-c5f82aaecfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:51.223140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fee75f-9dcf-4e5b-96fc-c5f82aaecfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:51.235141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fee75f-9dcf-4e5b-96fc-c5f82aaecfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:51.236983 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fee75f-9dcf-4e5b-96fc-c5f82aaecfa8 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:51.241134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a542c0-3951-4647-a129-c42d8c94d7a0 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:51.248063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 903/1804] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:40:51.251955 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:51.252939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:51.253294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:51.253644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] PATH_INFO: `/v3/users/e76ba796f18b412f9bf422c206577c8d` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:51.255078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76ba796f18b412f9bf422c206577c8d)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:51.257160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:51.481291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76ba796f18b412f9bf422c206577c8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:51.481964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76ba796f18b412f9bf422c206577c8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:51.553607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76ba796f18b412f9bf422c206577c8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:51.562929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76ba796f18b412f9bf422c206577c8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:51.593008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76ba796f18b412f9bf422c206577c8d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:51.601392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 902/1805] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:51 2022] DELETE /identity/v3/users/e76ba796f18b412f9bf422c206577c8d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:51.606187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf8521-ad21-4878-ae13-210e4212e8f6 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:51.606627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf8521-ad21-4878-ae13-210e4212e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:51.606738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf8521-ad21-4878-ae13-210e4212e8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:51.626614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d5bf8521-ad21-4878-ae13-210e4212e8f6 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:51.628007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d5bf8521-ad21-4878-ae13-210e4212e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:51.690355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 904/1806] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:51.700671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:51.702711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:51.748008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf8521-ad21-4878-ae13-210e4212e8f6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:51.750542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d5bf8521-ad21-4878-ae13-210e4212e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:51.765847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86bf10-a53b-4913-9760-2d3d69262d6f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:51.770469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef3926-8080-40e7-b141-027adc2e900f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:51.771434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef3926-8080-40e7-b141-027adc2e900f service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:51.771968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef3926-8080-40e7-b141-027adc2e900f service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:51.772448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef3926-8080-40e7-b141-027adc2e900f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:51.784478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef3926-8080-40e7-b141-027adc2e900f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:51.785932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef3926-8080-40e7-b141-027adc2e900f service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:51.786371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf8521-ad21-4878-ae13-210e4212e8f6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:51.793019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:51.794054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:51.794410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:51.794759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] PATH_INFO: `/v3/projects/3e6f767f384349e997ab7014963e3f41` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:51.796159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6f767f384349e997ab7014963e3f41)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:51.797011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 903/1807] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:51.798725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:51.905098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6f767f384349e997ab7014963e3f41', 'request_id': 'req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:51.912138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6f767f384349e997ab7014963e3f41', 'request_id': 'req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:51.919622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6f767f384349e997ab7014963e3f41', 'request_id': 'req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.005303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] The token cache is being invalidate because project 3e6f767f384349e997ab7014963e3f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:52.005720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.008562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.017405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 905/1808] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:51 2022] DELETE /identity/v3/projects/3e6f767f384349e997ab7014963e3f41 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:52.020656 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef3926-8080-40e7-b141-027adc2e900f service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:52.041502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:52.047491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef3926-8080-40e7-b141-027adc2e900f service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:52.157356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:52.158279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:52.158743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:52.159027 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] PATH_INFO: `/v3/users/b5e2aeefe5c445e58c3137bdecfbba65` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:52.162719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e2aeefe5c445e58c3137bdecfbba65)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:52.166592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:52.457682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e2aeefe5c445e58c3137bdecfbba65'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.470561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e2aeefe5c445e58c3137bdecfbba65'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.470712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:52.470712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:52.490248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc4a62-eff2-4dc2-b8ca-ec56d1ec299e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:52.502330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:52.502330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:52.502330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:52.502330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] PATH_INFO: `/v3/projects/8379c024098d4ed29c6e1a2063d98143` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:52.502873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8379c024098d4ed29c6e1a2063d98143)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:52.503656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:52.577807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e2aeefe5c445e58c3137bdecfbba65'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.593060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e2aeefe5c445e58c3137bdecfbba65'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.628283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e2aeefe5c445e58c3137bdecfbba65'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.636799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 904/1809] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:52 2022] DELETE /identity/v3/users/b5e2aeefe5c445e58c3137bdecfbba65 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:52.637802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:52.644360 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:52.668370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8379c024098d4ed29c6e1a2063d98143', 'request_id': 'req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.678790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8379c024098d4ed29c6e1a2063d98143', 'request_id': 'req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.691457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8379c024098d4ed29c6e1a2063d98143', 'request_id': 'req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.736849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c727-7318-40a1-b540-dfcc5b6d295a admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:52.803456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:52.804376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:52.804658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:52.804929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] PATH_INFO: `/v3/users/eae60fc0fd1146ee9df3ecda05aedc7a` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:52.806115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae60fc0fd1146ee9df3ecda05aedc7a)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:52.808104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:52.817275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] The token cache is being invalidate because project 8379c024098d4ed29c6e1a2063d98143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:52.817573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.819169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9bdd0475-b8f0-4b6b-9196-ddfb45750e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:52.820934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 906/1810] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:52 2022] DELETE /identity/v3/projects/8379c024098d4ed29c6e1a2063d98143 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:52.826127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd676-21fb-4a2d-a321-c7284b3bb885 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:52.826580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd676-21fb-4a2d-a321-c7284b3bb885 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:52.827008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd676-21fb-4a2d-a321-c7284b3bb885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:52.850053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ab7fd676-21fb-4a2d-a321-c7284b3bb885 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:52.851178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ab7fd676-21fb-4a2d-a321-c7284b3bb885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:52.859539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 907/1811] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:52.868324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f723-f719-4cbd-9931-9edc2431fd1e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:52.868609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f723-f719-4cbd-9931-9edc2431fd1e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:52.868935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f723-f719-4cbd-9931-9edc2431fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:52.887760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d999f723-f719-4cbd-9931-9edc2431fd1e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:52.889011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d999f723-f719-4cbd-9931-9edc2431fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:52.896999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 908/1812] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:52.901653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999f723-f719-4cbd-9931-9edc2431fd1e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:52.910942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999f723-f719-4cbd-9931-9edc2431fd1e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:52.916461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1f0f-7b8d-4667-b308-90dd3a80b9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:52.916762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1f0f-7b8d-4667-b308-90dd3a80b9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:52.917048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1f0f-7b8d-4667-b308-90dd3a80b9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:52.917325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1f0f-7b8d-4667-b308-90dd3a80b9d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:52.918048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1f0f-7b8d-4667-b308-90dd3a80b9d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:40:52.918354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1f0f-7b8d-4667-b308-90dd3a80b9d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:52.920142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1f0f-7b8d-4667-b308-90dd3a80b9d9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:52.943087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 909/1813] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:40:52.944595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1f0f-7b8d-4667-b308-90dd3a80b9d9 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:52.956907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1f0f-7b8d-4667-b308-90dd3a80b9d9 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:52.963841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7684be-9868-4203-b95f-7ce5d7967a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:52.964505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7684be-9868-4203-b95f-7ce5d7967a0e admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:52.964884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7684be-9868-4203-b95f-7ce5d7967a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:52.965204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7684be-9868-4203-b95f-7ce5d7967a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:52.966200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7684be-9868-4203-b95f-7ce5d7967a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:52.968942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7684be-9868-4203-b95f-7ce5d7967a0e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:53.047665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae60fc0fd1146ee9df3ecda05aedc7a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.048668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae60fc0fd1146ee9df3ecda05aedc7a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.067853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 910/1814] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:52 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:53.069754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7684be-9868-4203-b95f-7ce5d7967a0e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:53.148675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7684be-9868-4203-b95f-7ce5d7967a0e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:53.153213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3604ba-8113-4472-a5b6-cacf4f92af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:53.153875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3604ba-8113-4472-a5b6-cacf4f92af16 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.154158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3604ba-8113-4472-a5b6-cacf4f92af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.154434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3604ba-8113-4472-a5b6-cacf4f92af16 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.155109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3604ba-8113-4472-a5b6-cacf4f92af16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:53.158084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3604ba-8113-4472-a5b6-cacf4f92af16 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:53.205389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae60fc0fd1146ee9df3ecda05aedc7a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.213145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae60fc0fd1146ee9df3ecda05aedc7a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.224944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2f69ef4b-f1ee-4081-8d87-5e0de9a86eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae60fc0fd1146ee9df3ecda05aedc7a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.231236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 905/1815] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:52 2022] DELETE /identity/v3/users/eae60fc0fd1146ee9df3ecda05aedc7a => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:53.243321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f240649-1def-4dc3-8a07-6c9e9ed2a9c5 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.244278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f240649-1def-4dc3-8a07-6c9e9ed2a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.244585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f240649-1def-4dc3-8a07-6c9e9ed2a9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.248684 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 911/1816] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:53 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:53.269525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7f240649-1def-4dc3-8a07-6c9e9ed2a9c5 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:53.270804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7f240649-1def-4dc3-8a07-6c9e9ed2a9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:53.271610 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3604ba-8113-4472-a5b6-cacf4f92af16 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:53.273523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-eb3604ba-8113-4472-a5b6-cacf4f92af16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:53.298924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3604ba-8113-4472-a5b6-cacf4f92af16 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:53.355602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 906/1817] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:53.357718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f240649-1def-4dc3-8a07-6c9e9ed2a9c5 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:53.365970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7f240649-1def-4dc3-8a07-6c9e9ed2a9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:53.379422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:53.380288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f240649-1def-4dc3-8a07-6c9e9ed2a9c5 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:53.380462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.380994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.381403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] PATH_INFO: `/v3/projects/f4e43098d29f4d30bb62b4d7022c7643` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.382971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e43098d29f4d30bb62b4d7022c7643)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:53.384990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:53.386731 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4e25-f6fc-4af1-a03a-470d3a93fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:53.387528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4e25-f6fc-4af1-a03a-470d3a93fb97 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.388857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4e25-f6fc-4af1-a03a-470d3a93fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.389256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4e25-f6fc-4af1-a03a-470d3a93fb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.390069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4e25-f6fc-4af1-a03a-470d3a93fb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:53.391786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4e25-f6fc-4af1-a03a-470d3a93fb97 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:53.411852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 907/1818] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:53.412935 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4e25-f6fc-4af1-a03a-470d3a93fb97 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:53.415781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5aca4e25-f6fc-4af1-a03a-470d3a93fb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:53.502987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4e25-f6fc-4af1-a03a-470d3a93fb97 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:53.511028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063e71c-21c9-4eb3-8351-01bcab8ef521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:53.519007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063e71c-21c9-4eb3-8351-01bcab8ef521 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.519007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063e71c-21c9-4eb3-8351-01bcab8ef521 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.519007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063e71c-21c9-4eb3-8351-01bcab8ef521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.523630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063e71c-21c9-4eb3-8351-01bcab8ef521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:53.525416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063e71c-21c9-4eb3-8351-01bcab8ef521 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:53.531885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e43098d29f4d30bb62b4d7022c7643', 'request_id': 'req-b361ba64-75cf-4dd4-8b4e-722c58450ebb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.536446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 908/1819] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:53.537400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063e71c-21c9-4eb3-8351-01bcab8ef521 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:53.539112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e43098d29f4d30bb62b4d7022c7643', 'request_id': 'req-b361ba64-75cf-4dd4-8b4e-722c58450ebb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.548278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063e71c-21c9-4eb3-8351-01bcab8ef521 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:53.550451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e43098d29f4d30bb62b4d7022c7643', 'request_id': 'req-b361ba64-75cf-4dd4-8b4e-722c58450ebb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.613959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8b058-8ebe-40a7-9305-fcd1cc52c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:53.614738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8b058-8ebe-40a7-9305-fcd1cc52c47b admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.615082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8b058-8ebe-40a7-9305-fcd1cc52c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.615297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8b058-8ebe-40a7-9305-fcd1cc52c47b admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.616068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8b058-8ebe-40a7-9305-fcd1cc52c47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:53.617720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8b058-8ebe-40a7-9305-fcd1cc52c47b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:53.629669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 909/1820] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:53.635493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] The token cache is being invalidate because project f4e43098d29f4d30bb62b4d7022c7643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:53.635818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.636680 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8b058-8ebe-40a7-9305-fcd1cc52c47b admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:53.637372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b361ba64-75cf-4dd4-8b4e-722c58450ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:53.639220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 912/1821] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:53 2022] DELETE /identity/v3/projects/f4e43098d29f4d30bb62b4d7022c7643 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:53.644095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1cb5c-e43f-4edb-a908-36dd6584dc42 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.644374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1cb5c-e43f-4edb-a908-36dd6584dc42 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.651254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8b058-8ebe-40a7-9305-fcd1cc52c47b admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:53.652807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1cb5c-e43f-4edb-a908-36dd6584dc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.657653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32c78c-008c-4ca8-a461-05bfd9648c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:53.658698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32c78c-008c-4ca8-a461-05bfd9648c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.658986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32c78c-008c-4ca8-a461-05bfd9648c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.659460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32c78c-008c-4ca8-a461-05bfd9648c7c admin admin] PATH_INFO: `/v3/projects/273c864c7bf14725ae0cdb7503d05430/users/d90c7a28515c4feb93d4f088a7017fca/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.684571 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32c78c-008c-4ca8-a461-05bfd9648c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=273c864c7bf14725ae0cdb7503d05430, user_id=d90c7a28515c4feb93d4f088a7017fca, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:53.689653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32c78c-008c-4ca8-a461-05bfd9648c7c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:53.699535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4ba1cb5c-e43f-4edb-a908-36dd6584dc42 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:53.700804 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4ba1cb5c-e43f-4edb-a908-36dd6584dc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:53.718329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 913/1822] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:53.723885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cf1ce-91d6-4934-b2fa-0ef0f164819f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.729301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cf1ce-91d6-4934-b2fa-0ef0f164819f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.729301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cf1ce-91d6-4934-b2fa-0ef0f164819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.755643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ca2cf1ce-91d6-4934-b2fa-0ef0f164819f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:53.756886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ca2cf1ce-91d6-4934-b2fa-0ef0f164819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:53.768392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 914/1823] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:53.775210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cf1ce-91d6-4934-b2fa-0ef0f164819f None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:53.792615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cf1ce-91d6-4934-b2fa-0ef0f164819f None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:53.798424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa127f7-08fd-4323-b043-bb55d01e58b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:53.799707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa127f7-08fd-4323-b043-bb55d01e58b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.799964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa127f7-08fd-4323-b043-bb55d01e58b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.800250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa127f7-08fd-4323-b043-bb55d01e58b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.800999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa127f7-08fd-4323-b043-bb55d01e58b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:40:53.801312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa127f7-08fd-4323-b043-bb55d01e58b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:53.803272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa127f7-08fd-4323-b043-bb55d01e58b9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:53.825865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 915/1824] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:40:53.832710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa127f7-08fd-4323-b043-bb55d01e58b9 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:53.844685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa127f7-08fd-4323-b043-bb55d01e58b9 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:53.858522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 910/1825] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:53 2022] PUT /identity/v3/projects/273c864c7bf14725ae0cdb7503d05430/users/d90c7a28515c4feb93d4f088a7017fca/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:53.867536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285906-0e3e-4a0c-bd1d-638ecd63b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:53.867536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285906-0e3e-4a0c-bd1d-638ecd63b54a admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.867536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285906-0e3e-4a0c-bd1d-638ecd63b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.867536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285906-0e3e-4a0c-bd1d-638ecd63b54a admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.868054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5285906-0e3e-4a0c-bd1d-638ecd63b54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:53.868054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5285906-0e3e-4a0c-bd1d-638ecd63b54a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:53.868703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb248a-bc52-4a60-8b36-394f0ccea868 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:53.869347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb248a-bc52-4a60-8b36-394f0ccea868 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:53.869815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb248a-bc52-4a60-8b36-394f0ccea868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:53.928877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d2fb248a-bc52-4a60-8b36-394f0ccea868 None None] MFA Rules not processed for user `d90c7a28515c4feb93d4f088a7017fca`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:53.930460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d2fb248a-bc52-4a60-8b36-394f0ccea868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:53.953968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:53.993875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 916/1826] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:53 2022] POST /identity/v3/projects => generated 363 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:53.994803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285906-0e3e-4a0c-bd1d-638ecd63b54a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:53.998439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d5285906-0e3e-4a0c-bd1d-638ecd63b54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.006921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 911/1827] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:54.008298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb248a-bc52-4a60-8b36-394f0ccea868 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:54.088933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285906-0e3e-4a0c-bd1d-638ecd63b54a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.094793 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.095883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.096231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.096573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] PATH_INFO: `/v3/users/968c2a27cf3e422ebd26043126f23832` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.098352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968c2a27cf3e422ebd26043126f23832)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:54.100458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:54.197392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:54.225634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb248a-bc52-4a60-8b36-394f0ccea868 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.232108 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4046286-745a-437b-8049-5010b8c166bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.232781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4046286-745a-437b-8049-5010b8c166bc admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.233218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4046286-745a-437b-8049-5010b8c166bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.233662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4046286-745a-437b-8049-5010b8c166bc admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.235646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4046286-745a-437b-8049-5010b8c166bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:54.237588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4046286-745a-437b-8049-5010b8c166bc admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:54.382967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968c2a27cf3e422ebd26043126f23832'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.382967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968c2a27cf3e422ebd26043126f23832'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.396703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968c2a27cf3e422ebd26043126f23832'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.411086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 912/1828] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:54 2022] POST /identity/v3/users => generated 282 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:54.411086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4046286-745a-437b-8049-5010b8c166bc admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:54.414691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d4046286-745a-437b-8049-5010b8c166bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.427085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4046286-745a-437b-8049-5010b8c166bc admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.433304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288437be-b9b6-4d95-ba26-d9107902cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.433959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288437be-b9b6-4d95-ba26-d9107902cde2 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.434236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288437be-b9b6-4d95-ba26-d9107902cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.434505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288437be-b9b6-4d95-ba26-d9107902cde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.435184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288437be-b9b6-4d95-ba26-d9107902cde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:54.437105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288437be-b9b6-4d95-ba26-d9107902cde2 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:54.460971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968c2a27cf3e422ebd26043126f23832'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.473248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968c2a27cf3e422ebd26043126f23832'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.479648 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 917/1829] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:53 2022] DELETE /identity/v3/users/968c2a27cf3e422ebd26043126f23832 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:54.480475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:54.481792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.546270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42089799-ab73-4ab0-a384-9644bab08895 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.550768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.551651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.551960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.552235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] PATH_INFO: `/v3/projects/38d516bd37aa459a8e3f050f4f3de004` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.553397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d516bd37aa459a8e3f050f4f3de004)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:54.555293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:54.573222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 913/1830] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:54 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:54.578295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288437be-b9b6-4d95-ba26-d9107902cde2 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:54.580184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-288437be-b9b6-4d95-ba26-d9107902cde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.641934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288437be-b9b6-4d95-ba26-d9107902cde2 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.646919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7c70b-c083-4937-9091-709315dd256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.647594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c70b-c083-4937-9091-709315dd256f admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.648259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c70b-c083-4937-9091-709315dd256f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.648601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c70b-c083-4937-9091-709315dd256f admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.649356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7c70b-c083-4937-9091-709315dd256f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:54.651525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7c70b-c083-4937-9091-709315dd256f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:54.662377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 914/1831] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:54.663801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64bf46-597c-4c1b-ad1a-6af7eec144e6 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.664097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64bf46-597c-4c1b-ad1a-6af7eec144e6 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.664378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64bf46-597c-4c1b-ad1a-6af7eec144e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.683038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4b64bf46-597c-4c1b-ad1a-6af7eec144e6 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:54.684233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4b64bf46-597c-4c1b-ad1a-6af7eec144e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.692168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 915/1832] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:54.696395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64bf46-597c-4c1b-ad1a-6af7eec144e6 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:54.696395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4b64bf46-597c-4c1b-ad1a-6af7eec144e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.707651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64bf46-597c-4c1b-ad1a-6af7eec144e6 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.710611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d516bd37aa459a8e3f050f4f3de004', 'request_id': 'req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.716811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d516bd37aa459a8e3f050f4f3de004', 'request_id': 'req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.723119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d516bd37aa459a8e3f050f4f3de004', 'request_id': 'req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.770794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bffdf0-84d5-434c-a294-497853a87c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.771469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bffdf0-84d5-434c-a294-497853a87c55 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.771843 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bffdf0-84d5-434c-a294-497853a87c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.772130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bffdf0-84d5-434c-a294-497853a87c55 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.772813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bffdf0-84d5-434c-a294-497853a87c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:54.774726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bffdf0-84d5-434c-a294-497853a87c55 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:54.787357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] The token cache is being invalidate because project 38d516bd37aa459a8e3f050f4f3de004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:54.791843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.791843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:54.791843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 918/1833] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:54 2022] DELETE /identity/v3/projects/38d516bd37aa459a8e3f050f4f3de004 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:54.791843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:54.793091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.807637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6082e4-d7ab-4bcd-afee-ae9a14cc4715 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.813079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2a698-4ab6-4cc8-9f68-d7fb6a008c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.813901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2a698-4ab6-4cc8-9f68-d7fb6a008c99 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.814195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2a698-4ab6-4cc8-9f68-d7fb6a008c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.814480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2a698-4ab6-4cc8-9f68-d7fb6a008c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.815216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2a698-4ab6-4cc8-9f68-d7fb6a008c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:54.816860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2a698-4ab6-4cc8-9f68-d7fb6a008c99 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:54.827121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 919/1834] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:54.828000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2a698-4ab6-4cc8-9f68-d7fb6a008c99 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:54.830943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-62e2a698-4ab6-4cc8-9f68-d7fb6a008c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.870675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 916/1835] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:54 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:54.872668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bffdf0-84d5-434c-a294-497853a87c55 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:54.874809 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b1bffdf0-84d5-434c-a294-497853a87c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.897896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bffdf0-84d5-434c-a294-497853a87c55 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.905382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.906786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.907371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.907849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] PATH_INFO: `/v3/users/ae8cf292032d4afba4f9edabd8b6b523` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.909595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8cf292032d4afba4f9edabd8b6b523)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:54.912909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:54.920020 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2a698-4ab6-4cc8-9f68-d7fb6a008c99 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.925785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20abad0-f727-4356-b29d-4483efd4e54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.926609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20abad0-f727-4356-b29d-4483efd4e54c service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.926741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20abad0-f727-4356-b29d-4483efd4e54c service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.927156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20abad0-f727-4356-b29d-4483efd4e54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:54.929146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e20abad0-f727-4356-b29d-4483efd4e54c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:54.945549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20abad0-f727-4356-b29d-4483efd4e54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:54.947851 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20abad0-f727-4356-b29d-4483efd4e54c service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:54.959112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 920/1836] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:54.960248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20abad0-f727-4356-b29d-4483efd4e54c service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:54.972328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20abad0-f727-4356-b29d-4483efd4e54c service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:54.978747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a69193-26d4-4064-96ea-37bc5b53ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:54.979786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69193-26d4-4064-96ea-37bc5b53ee99 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:54.980178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69193-26d4-4064-96ea-37bc5b53ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:54.980697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69193-26d4-4064-96ea-37bc5b53ee99 admin admin] PATH_INFO: `/v3/projects/41135cf16b7a4b91b43db0e230f1078e/users/d5afde58725c4b818077bdbfcb936990/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:55.003231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a69193-26d4-4064-96ea-37bc5b53ee99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41135cf16b7a4b91b43db0e230f1078e, user_id=d5afde58725c4b818077bdbfcb936990, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:55.006294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a69193-26d4-4064-96ea-37bc5b53ee99 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:55.099864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 921/1837] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:54 2022] PUT /identity/v3/projects/41135cf16b7a4b91b43db0e230f1078e/users/d5afde58725c4b818077bdbfcb936990/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:55.099864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a69193-26d4-4064-96ea-37bc5b53ee99 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:55.099864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-95a69193-26d4-4064-96ea-37bc5b53ee99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:55.182277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8cf292032d4afba4f9edabd8b6b523'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:55.182943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8cf292032d4afba4f9edabd8b6b523'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:55.186244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a69193-26d4-4064-96ea-37bc5b53ee99 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:55.192637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c0f8c-8c62-4714-a087-ade6aa3df203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:55.193702 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c0f8c-8c62-4714-a087-ade6aa3df203 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:55.193996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c0f8c-8c62-4714-a087-ade6aa3df203 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:55.194281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c0f8c-8c62-4714-a087-ade6aa3df203 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:55.195015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c0f8c-8c62-4714-a087-ade6aa3df203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:55.197922 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c0f8c-8c62-4714-a087-ade6aa3df203 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:55.208744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 922/1838] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:55.210241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d23246-0116-4ac3-bc10-c3cca9a59fcc None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:55.212052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d23246-0116-4ac3-bc10-c3cca9a59fcc None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:55.212413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d23246-0116-4ac3-bc10-c3cca9a59fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:55.241362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-04d23246-0116-4ac3-bc10-c3cca9a59fcc None None] MFA Rules not processed for user `d5afde58725c4b818077bdbfcb936990`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:55.242873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-04d23246-0116-4ac3-bc10-c3cca9a59fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:55.302617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8cf292032d4afba4f9edabd8b6b523'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:55.312090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8cf292032d4afba4f9edabd8b6b523'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:55.315156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 923/1839] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:55.319612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d23246-0116-4ac3-bc10-c3cca9a59fcc None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:55.332356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d23246-0116-4ac3-bc10-c3cca9a59fcc None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:55.333706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8cf292032d4afba4f9edabd8b6b523'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:55.337115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca867185-e89e-428d-98fe-f2f2200dd8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:55.337893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca867185-e89e-428d-98fe-f2f2200dd8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:55.338103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca867185-e89e-428d-98fe-f2f2200dd8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:55.338387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca867185-e89e-428d-98fe-f2f2200dd8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:55.339298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca867185-e89e-428d-98fe-f2f2200dd8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:55.343383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 917/1840] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:54 2022] DELETE /identity/v3/users/ae8cf292032d4afba4f9edabd8b6b523 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:55.344198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca867185-e89e-428d-98fe-f2f2200dd8b6 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:55.344756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:55.348227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:55.357003 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 924/1841] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:55.372964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca867185-e89e-428d-98fe-f2f2200dd8b6 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:55.379363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ca867185-e89e-428d-98fe-f2f2200dd8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:55.399429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca867185-e89e-428d-98fe-f2f2200dd8b6 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:55.682930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bac7c2-65aa-4544-903d-01fb4e71929e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:55.682930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbd71-3466-4929-af08-3a3deec209f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:55.682930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbd71-3466-4929-af08-3a3deec209f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:55.682930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbd71-3466-4929-af08-3a3deec209f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:55.683880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cbd71-3466-4929-af08-3a3deec209f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:55.683880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbd71-3466-4929-af08-3a3deec209f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:55.683880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cbd71-3466-4929-af08-3a3deec209f2 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:55.684620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e000-c474-4d88-be62-2bf3bde00d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:55.684620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e000-c474-4d88-be62-2bf3bde00d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:55.684620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e000-c474-4d88-be62-2bf3bde00d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:55.684620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e000-c474-4d88-be62-2bf3bde00d7d admin admin] PATH_INFO: `/v3/projects/d13e2e14c65f491ba02f35a5df3b27dd/users/16d25944b6944a469a0bed8c9399e67f/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:55.685445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e000-c474-4d88-be62-2bf3bde00d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13e2e14c65f491ba02f35a5df3b27dd, user_id=16d25944b6944a469a0bed8c9399e67f, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:55.685445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e000-c474-4d88-be62-2bf3bde00d7d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:55.826603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 918/1843] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:55 2022] POST /identity/v3/projects => generated 365 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:55.827931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbd71-3466-4929-af08-3a3deec209f2 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:55.829622 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6c4cbd71-3466-4929-af08-3a3deec209f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:55.835162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 925/1843] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:55 2022] PUT /identity/v3/projects/d13e2e14c65f491ba02f35a5df3b27dd/users/16d25944b6944a469a0bed8c9399e67f/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:55.836958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead52f23-8c53-47ba-b1da-2bc03b4513ed None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:55.837426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead52f23-8c53-47ba-b1da-2bc03b4513ed None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:55.837832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead52f23-8c53-47ba-b1da-2bc03b4513ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:55.873783 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ead52f23-8c53-47ba-b1da-2bc03b4513ed None None] MFA Rules not processed for user `16d25944b6944a469a0bed8c9399e67f`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:55.875224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ead52f23-8c53-47ba-b1da-2bc03b4513ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:55.920870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cbd71-3466-4929-af08-3a3deec209f2 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:55.928503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:55.928503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:55.928503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:55.928503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] PATH_INFO: `/v3/projects/c03e1c24ea1e4f44abe145fe2ac807db` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:55.929691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03e1c24ea1e4f44abe145fe2ac807db)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:55.933851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:56.003641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 926/1844] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:56.004665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead52f23-8c53-47ba-b1da-2bc03b4513ed None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:56.018074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead52f23-8c53-47ba-b1da-2bc03b4513ed None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:56.023200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cacb9f-3ff3-4c3e-a644-e3e54d06a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:56.023935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cacb9f-3ff3-4c3e-a644-e3e54d06a28b admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:56.024225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cacb9f-3ff3-4c3e-a644-e3e54d06a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:56.024497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cacb9f-3ff3-4c3e-a644-e3e54d06a28b admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:56.025219 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cacb9f-3ff3-4c3e-a644-e3e54d06a28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:56.027208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cacb9f-3ff3-4c3e-a644-e3e54d06a28b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:56.130625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 927/1845] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:56 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:56.133787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cacb9f-3ff3-4c3e-a644-e3e54d06a28b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:56.148312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cacb9f-3ff3-4c3e-a644-e3e54d06a28b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:56.149287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03e1c24ea1e4f44abe145fe2ac807db', 'request_id': 'req-8901764e-dc34-45ad-839f-d30e1a3a3721'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.163087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03e1c24ea1e4f44abe145fe2ac807db', 'request_id': 'req-8901764e-dc34-45ad-839f-d30e1a3a3721'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.208161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29a095-f39e-4b88-a87b-95282ab85dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:56.208836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29a095-f39e-4b88-a87b-95282ab85dda admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:56.209237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29a095-f39e-4b88-a87b-95282ab85dda admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:56.209551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29a095-f39e-4b88-a87b-95282ab85dda admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:56.210247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29a095-f39e-4b88-a87b-95282ab85dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:56.212210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29a095-f39e-4b88-a87b-95282ab85dda admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:56.253730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03e1c24ea1e4f44abe145fe2ac807db', 'request_id': 'req-8901764e-dc34-45ad-839f-d30e1a3a3721'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.262006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] The token cache is being invalidate because project c03e1c24ea1e4f44abe145fe2ac807db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:56.262305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.262958 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.267331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 919/1846] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:55 2022] DELETE /identity/v3/projects/c03e1c24ea1e4f44abe145fe2ac807db => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:56.267331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:56.267331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:56.280335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901764e-dc34-45ad-839f-d30e1a3a3721 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:56.285375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:56.286244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:56.286533 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:56.286813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] PATH_INFO: `/v3/projects/f83f0cbf1fba4ff8a93e2326261a1d98` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:56.288556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83f0cbf1fba4ff8a93e2326261a1d98)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:56.291164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:56.309792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 928/1847] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:56 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:56.310803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29a095-f39e-4b88-a87b-95282ab85dda admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:56.312081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fc29a095-f39e-4b88-a87b-95282ab85dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:56.380710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29a095-f39e-4b88-a87b-95282ab85dda admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:56.385897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5595e-4c59-441e-b195-071f06ade797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:56.386839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5595e-4c59-441e-b195-071f06ade797 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:56.387132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5595e-4c59-441e-b195-071f06ade797 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:56.387413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5595e-4c59-441e-b195-071f06ade797 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:56.388171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5595e-4c59-441e-b195-071f06ade797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:56.389807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5595e-4c59-441e-b195-071f06ade797 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:56.408356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 929/1848] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:56.408356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5595e-4c59-441e-b195-071f06ade797 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:56.408356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-94d5595e-4c59-441e-b195-071f06ade797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:56.411026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83f0cbf1fba4ff8a93e2326261a1d98', 'request_id': 'req-4d8116f2-725f-4e40-8db8-18a73ce5113e'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.418775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83f0cbf1fba4ff8a93e2326261a1d98', 'request_id': 'req-4d8116f2-725f-4e40-8db8-18a73ce5113e'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.420111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5595e-4c59-441e-b195-071f06ade797 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:56.476940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:56.477227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:56.477511 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:56.478000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] PATH_INFO: `/v3/users/80591028f0504faa9545249966c27fe1` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:56.479216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80591028f0504faa9545249966c27fe1)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:56.481199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:56.490405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83f0cbf1fba4ff8a93e2326261a1d98', 'request_id': 'req-4d8116f2-725f-4e40-8db8-18a73ce5113e'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.504433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] The token cache is being invalidate because project f83f0cbf1fba4ff8a93e2326261a1d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:56.504725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.505410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.507074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 920/1849] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:56 2022] DELETE /identity/v3/projects/f83f0cbf1fba4ff8a93e2326261a1d98 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:56.512238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:56.513543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:56.523972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:56.528146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8116f2-725f-4e40-8db8-18a73ce5113e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:56.533037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f57519-79f5-4d50-af60-3cb4e7973b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:56.533653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f57519-79f5-4d50-af60-3cb4e7973b4e admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:56.533982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f57519-79f5-4d50-af60-3cb4e7973b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:56.534296 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f57519-79f5-4d50-af60-3cb4e7973b4e admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:56.534975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f57519-79f5-4d50-af60-3cb4e7973b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:56.536912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f57519-79f5-4d50-af60-3cb4e7973b4e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:56.653097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 921/1850] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:56 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:56.653919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f57519-79f5-4d50-af60-3cb4e7973b4e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:56.655527 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f8f57519-79f5-4d50-af60-3cb4e7973b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:56.667468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f57519-79f5-4d50-af60-3cb4e7973b4e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:56.672165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a971ea-9561-4ab1-a9c2-0e00d35a973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:56.673072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a971ea-9561-4ab1-a9c2-0e00d35a973e admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:56.677638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a971ea-9561-4ab1-a9c2-0e00d35a973e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:56.677638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a971ea-9561-4ab1-a9c2-0e00d35a973e admin admin] PATH_INFO: `/v3/projects/4367046b26a74f9e9b5741dd9ce2d31a/users/dd06c102f4434c3493294ba4795de53a/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:56.688230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a971ea-9561-4ab1-a9c2-0e00d35a973e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4367046b26a74f9e9b5741dd9ce2d31a, user_id=dd06c102f4434c3493294ba4795de53a, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:56.690864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a971ea-9561-4ab1-a9c2-0e00d35a973e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:56.744388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80591028f0504faa9545249966c27fe1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.744972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80591028f0504faa9545249966c27fe1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.751716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80591028f0504faa9545249966c27fe1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.862670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 922/1851] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:56 2022] PUT /identity/v3/projects/4367046b26a74f9e9b5741dd9ce2d31a/users/dd06c102f4434c3493294ba4795de53a/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:56.863991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69b548-27c2-488c-8953-e83790fc302c None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:56.864282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69b548-27c2-488c-8953-e83790fc302c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:56.864561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69b548-27c2-488c-8953-e83790fc302c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:56.881976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7a69b548-27c2-488c-8953-e83790fc302c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:56.883334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7a69b548-27c2-488c-8953-e83790fc302c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:56.913422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80591028f0504faa9545249966c27fe1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.925750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80591028f0504faa9545249966c27fe1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:56.932400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 930/1852] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:40:56 2022] DELETE /identity/v3/users/80591028f0504faa9545249966c27fe1 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:56.933191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:56.934703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:56.955314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 923/1853] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:56.956276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69b548-27c2-488c-8953-e83790fc302c None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:56.957624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7a69b548-27c2-488c-8953-e83790fc302c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:56.973173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69b548-27c2-488c-8953-e83790fc302c None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.030420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc4d25-b4cb-45d4-b869-de75fa401b9e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.035250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270192f9-f5bb-4d67-91df-d5a687b36793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.040709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270192f9-f5bb-4d67-91df-d5a687b36793 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.041582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270192f9-f5bb-4d67-91df-d5a687b36793 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.041853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270192f9-f5bb-4d67-91df-d5a687b36793 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.042620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270192f9-f5bb-4d67-91df-d5a687b36793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.044433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270192f9-f5bb-4d67-91df-d5a687b36793 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.048085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe7736-01cb-4cc7-b90a-b1dfc9e70bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.048987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe7736-01cb-4cc7-b90a-b1dfc9e70bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.049435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe7736-01cb-4cc7-b90a-b1dfc9e70bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.050006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe7736-01cb-4cc7-b90a-b1dfc9e70bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.050905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe7736-01cb-4cc7-b90a-b1dfc9e70bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.052555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe7736-01cb-4cc7-b90a-b1dfc9e70bc8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.060075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 931/1854] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:57.061554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0ce79-efdb-47b0-b965-6f8c76af8226 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.061847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0ce79-efdb-47b0-b965-6f8c76af8226 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.062123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0ce79-efdb-47b0-b965-6f8c76af8226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.066651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 924/1855] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:57.066651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe7736-01cb-4cc7-b90a-b1dfc9e70bc8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.076534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe7736-01cb-4cc7-b90a-b1dfc9e70bc8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.082630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb700d-18d1-4a99-985e-6f109835f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.083252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-fdb0ce79-efdb-47b0-b965-6f8c76af8226 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:57.084113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb700d-18d1-4a99-985e-6f109835f3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.084400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb700d-18d1-4a99-985e-6f109835f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.084684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb700d-18d1-4a99-985e-6f109835f3cb admin admin] PATH_INFO: `/v3/projects/7ca8ab460cca48fa986ff2b1c881538d/users/c18643dc21184959a3530d24b0b674e1/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.084818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fdb0ce79-efdb-47b0-b965-6f8c76af8226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.092852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 932/1856] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:57.093647 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0ce79-efdb-47b0-b965-6f8c76af8226 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.100022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb700d-18d1-4a99-985e-6f109835f3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca8ab460cca48fa986ff2b1c881538d, user_id=c18643dc21184959a3530d24b0b674e1, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.102740 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb700d-18d1-4a99-985e-6f109835f3cb admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.105081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0ce79-efdb-47b0-b965-6f8c76af8226 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.109550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dd0ca-23de-4420-908a-c93eaf270829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.110443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dd0ca-23de-4420-908a-c93eaf270829 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.110732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dd0ca-23de-4420-908a-c93eaf270829 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.111006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dd0ca-23de-4420-908a-c93eaf270829 admin admin] PATH_INFO: `/v3/projects/4367046b26a74f9e9b5741dd9ce2d31a/users/dd06c102f4434c3493294ba4795de53a/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.113056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39dd0ca-23de-4420-908a-c93eaf270829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4367046b26a74f9e9b5741dd9ce2d31a, user_id=dd06c102f4434c3493294ba4795de53a, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.115673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39dd0ca-23de-4420-908a-c93eaf270829 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.126488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 933/1857] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:57 2022] PUT /identity/v3/projects/4367046b26a74f9e9b5741dd9ce2d31a/users/dd06c102f4434c3493294ba4795de53a/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:57.127271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dd0ca-23de-4420-908a-c93eaf270829 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.190731 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 925/1858] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:57 2022] PUT /identity/v3/projects/7ca8ab460cca48fa986ff2b1c881538d/users/c18643dc21184959a3530d24b0b674e1/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:57.193755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8530-cc72-4068-aac9-3e38cf2c02fd None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.194134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8530-cc72-4068-aac9-3e38cf2c02fd None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.194747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8530-cc72-4068-aac9-3e38cf2c02fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.197868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dd0ca-23de-4420-908a-c93eaf270829 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.223670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-005c8530-cc72-4068-aac9-3e38cf2c02fd None None] MFA Rules not processed for user `dd06c102f4434c3493294ba4795de53a`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:57.224845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-005c8530-cc72-4068-aac9-3e38cf2c02fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.267927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd97b75-ec91-44cd-adcb-befbb43ab532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.268603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd97b75-ec91-44cd-adcb-befbb43ab532 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.268886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd97b75-ec91-44cd-adcb-befbb43ab532 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.269162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd97b75-ec91-44cd-adcb-befbb43ab532 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.269879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd97b75-ec91-44cd-adcb-befbb43ab532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:40:57.270285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd97b75-ec91-44cd-adcb-befbb43ab532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.272835 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd97b75-ec91-44cd-adcb-befbb43ab532 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.289807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 934/1859] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:40:57.291072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd97b75-ec91-44cd-adcb-befbb43ab532 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.304310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd97b75-ec91-44cd-adcb-befbb43ab532 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.311643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6b38e-b89d-4444-8497-cfe0ca7ba35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.311917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 926/1860] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:57.312717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8530-cc72-4068-aac9-3e38cf2c02fd None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.319853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6b38e-b89d-4444-8497-cfe0ca7ba35f admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.320510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6b38e-b89d-4444-8497-cfe0ca7ba35f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.320999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6b38e-b89d-4444-8497-cfe0ca7ba35f admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.323141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:57.323660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6b38e-b89d-4444-8497-cfe0ca7ba35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.326945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6b38e-b89d-4444-8497-cfe0ca7ba35f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.327505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8530-cc72-4068-aac9-3e38cf2c02fd None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.332716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a46625-2cb6-40a1-8580-45216f37223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.333389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a46625-2cb6-40a1-8580-45216f37223c admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.333806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a46625-2cb6-40a1-8580-45216f37223c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.334154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a46625-2cb6-40a1-8580-45216f37223c admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.334953 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a46625-2cb6-40a1-8580-45216f37223c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.336919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a46625-2cb6-40a1-8580-45216f37223c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.338476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 935/1861] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:57.339580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6b38e-b89d-4444-8497-cfe0ca7ba35f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.343505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f5d6b38e-b89d-4444-8497-cfe0ca7ba35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.402881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6b38e-b89d-4444-8497-cfe0ca7ba35f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.406768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c57e0-7b7d-4927-9d9d-b6391704d69d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.407525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c57e0-7b7d-4927-9d9d-b6391704d69d service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.407943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c57e0-7b7d-4927-9d9d-b6391704d69d service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.412967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c57e0-7b7d-4927-9d9d-b6391704d69d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.418337 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c57e0-7b7d-4927-9d9d-b6391704d69d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.419826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c57e0-7b7d-4927-9d9d-b6391704d69d service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.430867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 936/1862] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:57.432375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c57e0-7b7d-4927-9d9d-b6391704d69d service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.443993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c57e0-7b7d-4927-9d9d-b6391704d69d service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.449537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd5444-7289-4e06-8861-c8097adc508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.455310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd5444-7289-4e06-8861-c8097adc508b admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.455310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd5444-7289-4e06-8861-c8097adc508b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.455310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd5444-7289-4e06-8861-c8097adc508b admin admin] PATH_INFO: `/v3/projects/7ca8ab460cca48fa986ff2b1c881538d/users/c18643dc21184959a3530d24b0b674e1/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.455613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 927/1863] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:57 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:57.455707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd5444-7289-4e06-8861-c8097adc508b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca8ab460cca48fa986ff2b1c881538d, user_id=c18643dc21184959a3530d24b0b674e1, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.456133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd5444-7289-4e06-8861-c8097adc508b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.457586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a46625-2cb6-40a1-8580-45216f37223c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.469573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 937/1864] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:57 2022] PUT /identity/v3/projects/7ca8ab460cca48fa986ff2b1c881538d/users/c18643dc21184959a3530d24b0b674e1/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:57.481151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f59c-9de0-4b09-a6ef-6ae12597c108 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.482837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f59c-9de0-4b09-a6ef-6ae12597c108 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.482837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f59c-9de0-4b09-a6ef-6ae12597c108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.509417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-dfd6f59c-9de0-4b09-a6ef-6ae12597c108 None None] MFA Rules not processed for user `c18643dc21184959a3530d24b0b674e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:57.512014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dfd6f59c-9de0-4b09-a6ef-6ae12597c108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.535944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a46625-2cb6-40a1-8580-45216f37223c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.614783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760dfd6-0b6f-4f6e-93e4-a6d0225187bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.614783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760dfd6-0b6f-4f6e-93e4-a6d0225187bf admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.615149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760dfd6-0b6f-4f6e-93e4-a6d0225187bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.615311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760dfd6-0b6f-4f6e-93e4-a6d0225187bf admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.615945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 938/1865] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:57.616183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760dfd6-0b6f-4f6e-93e4-a6d0225187bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.616568 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f59c-9de0-4b09-a6ef-6ae12597c108 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.618039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dfd6f59c-9de0-4b09-a6ef-6ae12597c108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.618413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760dfd6-0b6f-4f6e-93e4-a6d0225187bf admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.634890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f59c-9de0-4b09-a6ef-6ae12597c108 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.640813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.642354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.642808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.643281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] PATH_INFO: `/v3/projects/7a065ad652fe4c91ac7e33d511cfe5b4` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.645396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a065ad652fe4c91ac7e33d511cfe5b4)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.650574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.731434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 928/1866] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:57 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:57.732326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760dfd6-0b6f-4f6e-93e4-a6d0225187bf admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.774397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a065ad652fe4c91ac7e33d511cfe5b4', 'request_id': 'req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:57.780564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a065ad652fe4c91ac7e33d511cfe5b4', 'request_id': 'req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:57.787900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a065ad652fe4c91ac7e33d511cfe5b4', 'request_id': 'req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:57.789129 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760dfd6-0b6f-4f6e-93e4-a6d0225187bf admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.837941 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.838645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.838931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.839202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.841040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.856797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] The token cache is being invalidate because project 7a065ad652fe4c91ac7e33d511cfe5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:40:57.857092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:57.857854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:40:57.859455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 939/1867] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:40:57 2022] DELETE /identity/v3/projects/7a065ad652fe4c91ac7e33d511cfe5b4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:57.860255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.861618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.903997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.905536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.915083 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 929/1868] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:57.916636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:57.917973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.929692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36068bd-7b99-4a73-bd35-db2f1448ed16 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.931086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6acdfb-ce20-4e1d-a36e-a24855d32c44 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:57.933910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ac955-19a4-48c9-9f1c-1a82f7f52f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.934727 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ac955-19a4-48c9-9f1c-1a82f7f52f34 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.935263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ac955-19a4-48c9-9f1c-1a82f7f52f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.935548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ac955-19a4-48c9-9f1c-1a82f7f52f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.936268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55330f-2972-4dcc-83b8-06ab9289afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:57.936936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55330f-2972-4dcc-83b8-06ab9289afb4 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.937268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55330f-2972-4dcc-83b8-06ab9289afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.937357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-227ac955-19a4-48c9-9f1c-1a82f7f52f34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.937548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55330f-2972-4dcc-83b8-06ab9289afb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.938430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55330f-2972-4dcc-83b8-06ab9289afb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:57.940042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55330f-2972-4dcc-83b8-06ab9289afb4 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:57.951010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 940/1869] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:57.952404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad9b18-1964-4d15-ac76-77b5fbcb3632 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:57.952691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad9b18-1964-4d15-ac76-77b5fbcb3632 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:57.952964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad9b18-1964-4d15-ac76-77b5fbcb3632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:57.972273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-f2ad9b18-1964-4d15-ac76-77b5fbcb3632 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:57.973474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f2ad9b18-1964-4d15-ac76-77b5fbcb3632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:57.984104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 941/1870] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:57.991222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad9b18-1964-4d15-ac76-77b5fbcb3632 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.012741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad9b18-1964-4d15-ac76-77b5fbcb3632 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.017922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ac955-19a4-48c9-9f1c-1a82f7f52f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.019429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ac955-19a4-48c9-9f1c-1a82f7f52f34 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.022308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c98cd-451e-4d60-a41d-e3753987654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.022308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c98cd-451e-4d60-a41d-e3753987654b admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.022308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c98cd-451e-4d60-a41d-e3753987654b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.022308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c98cd-451e-4d60-a41d-e3753987654b admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.022628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c98cd-451e-4d60-a41d-e3753987654b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.023658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c98cd-451e-4d60-a41d-e3753987654b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.029596 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 930/1871] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:58.030902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cee58e-92e4-4b27-9d2c-fc17c61b08f9 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.031195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cee58e-92e4-4b27-9d2c-fc17c61b08f9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.031479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cee58e-92e4-4b27-9d2c-fc17c61b08f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.036254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 942/1872] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:58.047962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c98cd-451e-4d60-a41d-e3753987654b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.059628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-24cee58e-92e4-4b27-9d2c-fc17c61b08f9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:58.061414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-24cee58e-92e4-4b27-9d2c-fc17c61b08f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:58.069066 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c98cd-451e-4d60-a41d-e3753987654b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.074197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 931/1873] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:58.077559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cee58e-92e4-4b27-9d2c-fc17c61b08f9 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.077938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137f7c9-62d1-480d-8128-1ea55692cecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.079071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137f7c9-62d1-480d-8128-1ea55692cecb admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.079437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137f7c9-62d1-480d-8128-1ea55692cecb admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.079892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137f7c9-62d1-480d-8128-1ea55692cecb admin admin] PATH_INFO: `/v3/projects/8b35c69cbc8f4701964cf9a84990d017/users/eca6d3b71ecf4033b94232c4963abe2e/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.088617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cee58e-92e4-4b27-9d2c-fc17c61b08f9 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.093423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52422-20a4-48b6-8ebd-d39a087b244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.094229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52422-20a4-48b6-8ebd-d39a087b244b admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.094512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52422-20a4-48b6-8ebd-d39a087b244b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.094799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52422-20a4-48b6-8ebd-d39a087b244b admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.095515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de52422-20a4-48b6-8ebd-d39a087b244b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:40:58.095854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de52422-20a4-48b6-8ebd-d39a087b244b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.098045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137f7c9-62d1-480d-8128-1ea55692cecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b35c69cbc8f4701964cf9a84990d017, user_id=eca6d3b71ecf4033b94232c4963abe2e, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.098287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de52422-20a4-48b6-8ebd-d39a087b244b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.099260 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137f7c9-62d1-480d-8128-1ea55692cecb admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.109758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 932/1874] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:40:58.114172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52422-20a4-48b6-8ebd-d39a087b244b admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.123611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52422-20a4-48b6-8ebd-d39a087b244b admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.128230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87531837-2b97-410c-8006-41db4addc5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.128849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87531837-2b97-410c-8006-41db4addc5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.129174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87531837-2b97-410c-8006-41db4addc5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.129447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87531837-2b97-410c-8006-41db4addc5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.130113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87531837-2b97-410c-8006-41db4addc5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.132018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87531837-2b97-410c-8006-41db4addc5f1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.171191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 943/1875] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:58 2022] PUT /identity/v3/projects/8b35c69cbc8f4701964cf9a84990d017/users/eca6d3b71ecf4033b94232c4963abe2e/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:58.182407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee741d-8f2a-4a6c-b8ac-efcc28130648 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.182694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee741d-8f2a-4a6c-b8ac-efcc28130648 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.182969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee741d-8f2a-4a6c-b8ac-efcc28130648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.208670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d1ee741d-8f2a-4a6c-b8ac-efcc28130648 None None] MFA Rules not processed for user `eca6d3b71ecf4033b94232c4963abe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:58.209906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d1ee741d-8f2a-4a6c-b8ac-efcc28130648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:58.247064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 933/1876] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:58 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:40:58.251163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87531837-2b97-410c-8006-41db4addc5f1 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.280285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 944/1877] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:58.284698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee741d-8f2a-4a6c-b8ac-efcc28130648 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.316040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87531837-2b97-410c-8006-41db4addc5f1 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.320767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ea60e-6def-4135-80b4-5ec297097284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.321463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ea60e-6def-4135-80b4-5ec297097284 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.322356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ea60e-6def-4135-80b4-5ec297097284 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.322669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ea60e-6def-4135-80b4-5ec297097284 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.323352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ea60e-6def-4135-80b4-5ec297097284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.325356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ea60e-6def-4135-80b4-5ec297097284 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.344935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee741d-8f2a-4a6c-b8ac-efcc28130648 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.349606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b323-bbcb-4424-88fe-9a77e933c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.350257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b323-bbcb-4424-88fe-9a77e933c1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.350535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b323-bbcb-4424-88fe-9a77e933c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.350866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b323-bbcb-4424-88fe-9a77e933c1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.351548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b323-bbcb-4424-88fe-9a77e933c1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.353538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b323-bbcb-4424-88fe-9a77e933c1c3 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.407487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 934/1878] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:58 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:40:58.409274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ea60e-6def-4135-80b4-5ec297097284 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.418961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ea60e-6def-4135-80b4-5ec297097284 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.423568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43c214-3b6e-474f-b8d4-df9fefb28d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.424258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43c214-3b6e-474f-b8d4-df9fefb28d85 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.424547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43c214-3b6e-474f-b8d4-df9fefb28d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.424828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43c214-3b6e-474f-b8d4-df9fefb28d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.425542 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43c214-3b6e-474f-b8d4-df9fefb28d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.430224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43c214-3b6e-474f-b8d4-df9fefb28d85 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.441950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 935/1879] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:40:58.445973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43c214-3b6e-474f-b8d4-df9fefb28d85 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.458410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43c214-3b6e-474f-b8d4-df9fefb28d85 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.465235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8362d1-4b76-4127-949a-740b010e4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.466182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8362d1-4b76-4127-949a-740b010e4b7e admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.466794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8362d1-4b76-4127-949a-740b010e4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.467257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8362d1-4b76-4127-949a-740b010e4b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.468446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8362d1-4b76-4127-949a-740b010e4b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.472107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8362d1-4b76-4127-949a-740b010e4b7e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.483833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 936/1880] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:40:58.488134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8362d1-4b76-4127-949a-740b010e4b7e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.498897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8362d1-4b76-4127-949a-740b010e4b7e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.504201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadddbb8-df6d-44a9-89d7-4a5e0a70b91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.505246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadddbb8-df6d-44a9-89d7-4a5e0a70b91e admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.505651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadddbb8-df6d-44a9-89d7-4a5e0a70b91e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.505990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadddbb8-df6d-44a9-89d7-4a5e0a70b91e admin admin] PATH_INFO: `/v3/projects/bced6326dec74e15b5adfbc906be1090/users/d9f6b383992d46f9aad3a036c6071529/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.511178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 945/1881] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:58 2022] POST /identity/v3/projects => generated 377 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:40:58.514913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b323-bbcb-4424-88fe-9a77e933c1c3 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.523231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadddbb8-df6d-44a9-89d7-4a5e0a70b91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bced6326dec74e15b5adfbc906be1090, user_id=d9f6b383992d46f9aad3a036c6071529, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.526039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadddbb8-df6d-44a9-89d7-4a5e0a70b91e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.581068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b323-bbcb-4424-88fe-9a77e933c1c3 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.590578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ee5c-64b0-410e-850e-78be535316aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.590578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ee5c-64b0-410e-850e-78be535316aa admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.590578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ee5c-64b0-410e-850e-78be535316aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.590578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ee5c-64b0-410e-850e-78be535316aa admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.590926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8ee5c-64b0-410e-850e-78be535316aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.591906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8ee5c-64b0-410e-850e-78be535316aa admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.623308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 937/1882] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:58 2022] PUT /identity/v3/projects/bced6326dec74e15b5adfbc906be1090/users/d9f6b383992d46f9aad3a036c6071529/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:58.637195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d07d-93ff-49c1-b3f8-b6e2cd33cf33 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.640667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d07d-93ff-49c1-b3f8-b6e2cd33cf33 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.640667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d07d-93ff-49c1-b3f8-b6e2cd33cf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.665080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-dbf0d07d-93ff-49c1-b3f8-b6e2cd33cf33 None None] MFA Rules not processed for user `d9f6b383992d46f9aad3a036c6071529`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:58.666788 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-dbf0d07d-93ff-49c1-b3f8-b6e2cd33cf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:58.733373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 946/1883] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:58 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:40:58.734410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ee5c-64b0-410e-850e-78be535316aa admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.739551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 938/1884] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:58.744643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d07d-93ff-49c1-b3f8-b6e2cd33cf33 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.746373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ee5c-64b0-410e-850e-78be535316aa admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.781784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:58.826221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d07d-93ff-49c1-b3f8-b6e2cd33cf33 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.827870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17e4e3-35d7-4e0d-be7e-f5e245fd17be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.828539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17e4e3-35d7-4e0d-be7e-f5e245fd17be admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.828816 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17e4e3-35d7-4e0d-be7e-f5e245fd17be admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.829094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17e4e3-35d7-4e0d-be7e-f5e245fd17be admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.829784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17e4e3-35d7-4e0d-be7e-f5e245fd17be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.831880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17e4e3-35d7-4e0d-be7e-f5e245fd17be admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.841618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8367fa-5ee0-4fb5-b826-7bbc522efeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.842656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8367fa-5ee0-4fb5-b826-7bbc522efeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.843059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8367fa-5ee0-4fb5-b826-7bbc522efeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.843588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8367fa-5ee0-4fb5-b826-7bbc522efeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.844593 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8367fa-5ee0-4fb5-b826-7bbc522efeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.846463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8367fa-5ee0-4fb5-b826-7bbc522efeb5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:58.858267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 947/1885] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:58.864426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8367fa-5ee0-4fb5-b826-7bbc522efeb5 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:58.875288 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8367fa-5ee0-4fb5-b826-7bbc522efeb5 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:58.880105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97797532-a7f0-42d5-8719-8040000c25af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:58.880977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97797532-a7f0-42d5-8719-8040000c25af admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:58.881263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97797532-a7f0-42d5-8719-8040000c25af admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:58.881544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97797532-a7f0-42d5-8719-8040000c25af admin admin] PATH_INFO: `/v3/projects/5d1c8ba7cbfb46a3a11ffb1fc91fc4ba/users/79479375549841d8a46c14555cdc80f9/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:58.896138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97797532-a7f0-42d5-8719-8040000c25af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1c8ba7cbfb46a3a11ffb1fc91fc4ba, user_id=79479375549841d8a46c14555cdc80f9, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:58.898803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97797532-a7f0-42d5-8719-8040000c25af admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.010847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 948/1886] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:58 2022] PUT /identity/v3/projects/5d1c8ba7cbfb46a3a11ffb1fc91fc4ba/users/79479375549841d8a46c14555cdc80f9/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:59.026829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 939/1887] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:40:58 2022] POST /identity/v3/projects => generated 387 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:40:59.027283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97797532-a7f0-42d5-8719-8040000c25af admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:59.027496 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17e4e3-35d7-4e0d-be7e-f5e245fd17be admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:59.078392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97797532-a7f0-42d5-8719-8040000c25af admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:59.081167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17e4e3-35d7-4e0d-be7e-f5e245fd17be admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:59.084598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b99f9-8c3a-4047-b91b-d4977e19cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:59.085334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b99f9-8c3a-4047-b91b-d4977e19cb3d admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.085620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b99f9-8c3a-4047-b91b-d4977e19cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.085896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b99f9-8c3a-4047-b91b-d4977e19cb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.086080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1893-c655-4216-b495-1debbe78302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:59.086618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b99f9-8c3a-4047-b91b-d4977e19cb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:59.086743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1893-c655-4216-b495-1debbe78302a admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.087095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1893-c655-4216-b495-1debbe78302a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.087966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1893-c655-4216-b495-1debbe78302a admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.088655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1893-c655-4216-b495-1debbe78302a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:59.088905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b99f9-8c3a-4047-b91b-d4977e19cb3d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.090557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1893-c655-4216-b495-1debbe78302a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.100997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 949/1888] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:59.112752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b99f9-8c3a-4047-b91b-d4977e19cb3d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:59.115259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b99f9-8c3a-4047-b91b-d4977e19cb3d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:59.119906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f60ad-db66-426a-ba5d-ad2e1231597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:59.120749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f60ad-db66-426a-ba5d-ad2e1231597c admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.121033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f60ad-db66-426a-ba5d-ad2e1231597c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.121311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f60ad-db66-426a-ba5d-ad2e1231597c admin admin] PATH_INFO: `/v3/projects/5d1c8ba7cbfb46a3a11ffb1fc91fc4ba/users/79479375549841d8a46c14555cdc80f9/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.123268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f60ad-db66-426a-ba5d-ad2e1231597c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1c8ba7cbfb46a3a11ffb1fc91fc4ba, user_id=79479375549841d8a46c14555cdc80f9, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:59.125977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f60ad-db66-426a-ba5d-ad2e1231597c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.135859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 950/1889] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:59 2022] PUT /identity/v3/projects/5d1c8ba7cbfb46a3a11ffb1fc91fc4ba/users/79479375549841d8a46c14555cdc80f9/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:59.141479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:59.150396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c8cd-3d4c-4a23-9e13-eff23d153f59 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.150690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c8cd-3d4c-4a23-9e13-eff23d153f59 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.150969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c8cd-3d4c-4a23-9e13-eff23d153f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.177472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-cbd6c8cd-3d4c-4a23-9e13-eff23d153f59 None None] MFA Rules not processed for user `79479375549841d8a46c14555cdc80f9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:59.178672 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cbd6c8cd-3d4c-4a23-9e13-eff23d153f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:59.245301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 951/1890] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:40:59.257287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6c8cd-3d4c-4a23-9e13-eff23d153f59 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:59.258621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cbd6c8cd-3d4c-4a23-9e13-eff23d153f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:59.268497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 940/1891] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:40:59 2022] POST /identity/v3/users => generated 300 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:40:59.272366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1893-c655-4216-b495-1debbe78302a admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:59.282609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1893-c655-4216-b495-1debbe78302a admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:59.318832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6c8cd-3d4c-4a23-9e13-eff23d153f59 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:59.324696 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb994bd-9102-436b-8dc0-278a17a2ee44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:59.325345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb994bd-9102-436b-8dc0-278a17a2ee44 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.325630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb994bd-9102-436b-8dc0-278a17a2ee44 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.325929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb994bd-9102-436b-8dc0-278a17a2ee44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.344520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be42cd8-4ec8-4879-a1b2-f9a80fc5c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:59.344974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be42cd8-4ec8-4879-a1b2-f9a80fc5c18c admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.345320 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be42cd8-4ec8-4879-a1b2-f9a80fc5c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.345665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be42cd8-4ec8-4879-a1b2-f9a80fc5c18c admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.346524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be42cd8-4ec8-4879-a1b2-f9a80fc5c18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:59.348141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be42cd8-4ec8-4879-a1b2-f9a80fc5c18c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.359452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 941/1892] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:40:59.363161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be42cd8-4ec8-4879-a1b2-f9a80fc5c18c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:59.374353 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be42cd8-4ec8-4879-a1b2-f9a80fc5c18c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:59.379381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbcbf1-73a6-48fd-bbdf-00c4f6866b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:59.381088 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbcbf1-73a6-48fd-bbdf-00c4f6866b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.381088 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbcbf1-73a6-48fd-bbdf-00c4f6866b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.381088 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbcbf1-73a6-48fd-bbdf-00c4f6866b93 admin admin] PATH_INFO: `/v3/projects/38d9d3b80c1e4ad9a4570849c4f422fd/users/d9f8a261e432417581a0441491d710b0/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.390637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb994bd-9102-436b-8dc0-278a17a2ee44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:59.392230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb994bd-9102-436b-8dc0-278a17a2ee44 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.397349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbcbf1-73a6-48fd-bbdf-00c4f6866b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d9d3b80c1e4ad9a4570849c4f422fd, user_id=d9f8a261e432417581a0441491d710b0, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:59.400620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbcbf1-73a6-48fd-bbdf-00c4f6866b93 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.402642 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 952/1893] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:40:59.482264 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 942/1894] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:59 2022] PUT /identity/v3/projects/38d9d3b80c1e4ad9a4570849c4f422fd/users/d9f8a261e432417581a0441491d710b0/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:40:59.483439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb994bd-9102-436b-8dc0-278a17a2ee44 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:59.495571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb994bd-9102-436b-8dc0-278a17a2ee44 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:59.561073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cc569-642c-4bc4-af96-1348f7526318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:59.561721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cc569-642c-4bc4-af96-1348f7526318 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.562005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cc569-642c-4bc4-af96-1348f7526318 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.562283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cc569-642c-4bc4-af96-1348f7526318 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.563008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cc569-642c-4bc4-af96-1348f7526318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:59.564659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cc569-642c-4bc4-af96-1348f7526318 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.576921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 953/1895] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:40:59.590413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbcbf1-73a6-48fd-bbdf-00c4f6866b93 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:59.600926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbcbf1-73a6-48fd-bbdf-00c4f6866b93 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:59.605914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce4c6-fba9-4854-888e-0078705914e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:59.606803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce4c6-fba9-4854-888e-0078705914e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.607253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce4c6-fba9-4854-888e-0078705914e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.607360 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce4c6-fba9-4854-888e-0078705914e7 admin admin] PATH_INFO: `/v3/projects/38d9d3b80c1e4ad9a4570849c4f422fd/users/d9f8a261e432417581a0441491d710b0/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.609383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce4c6-fba9-4854-888e-0078705914e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d9d3b80c1e4ad9a4570849c4f422fd, user_id=d9f8a261e432417581a0441491d710b0, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:59.612050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce4c6-fba9-4854-888e-0078705914e7 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.623431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 943/1896] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:40:59 2022] PUT /identity/v3/projects/38d9d3b80c1e4ad9a4570849c4f422fd/users/d9f8a261e432417581a0441491d710b0/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:40:59.633630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1802cf-2b0b-4a67-8ef0-6c837443aab3 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.634647 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1802cf-2b0b-4a67-8ef0-6c837443aab3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.635133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1802cf-2b0b-4a67-8ef0-6c837443aab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.663028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-aa1802cf-2b0b-4a67-8ef0-6c837443aab3 None None] MFA Rules not processed for user `d9f8a261e432417581a0441491d710b0`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:59.664285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-aa1802cf-2b0b-4a67-8ef0-6c837443aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:59.756692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 954/1897] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:40:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:59.792512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce4c6-fba9-4854-888e-0078705914e7 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:59.794230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-166ce4c6-fba9-4854-888e-0078705914e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:59.867429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce4c6-fba9-4854-888e-0078705914e7 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:59.891150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0ca79-bb67-4be6-a005-c0c9f34709f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:59.891995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0ca79-bb67-4be6-a005-c0c9f34709f1 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:59.894040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0ca79-bb67-4be6-a005-c0c9f34709f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:59.894040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0ca79-bb67-4be6-a005-c0c9f34709f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:59.904519 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0ca79-bb67-4be6-a005-c0c9f34709f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:59.906228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0ca79-bb67-4be6-a005-c0c9f34709f1 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:59.930548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 944/1898] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:00.282300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1802cf-2b0b-4a67-8ef0-6c837443aab3 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:00.351723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1802cf-2b0b-4a67-8ef0-6c837443aab3 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:00.366075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:00.366075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:00.366075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:00.366075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] PATH_INFO: `/v3/users/d9f6b383992d46f9aad3a036c6071529` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:00.366406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f6b383992d46f9aad3a036c6071529)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:00.366406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:00.551519 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0ca79-bb67-4be6-a005-c0c9f34709f1 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:00.558694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:00.564177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0ca79-bb67-4be6-a005-c0c9f34709f1 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:00.567986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea321e72-63d5-47c3-8211-1fea80793ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:00.568641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea321e72-63d5-47c3-8211-1fea80793ddc service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:00.568923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea321e72-63d5-47c3-8211-1fea80793ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:00.569201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea321e72-63d5-47c3-8211-1fea80793ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:00.571002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ea321e72-63d5-47c3-8211-1fea80793ddc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:00.607967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f6b383992d46f9aad3a036c6071529'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:00.609204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f6b383992d46f9aad3a036c6071529'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:00.621554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f6b383992d46f9aad3a036c6071529'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:00.648105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea321e72-63d5-47c3-8211-1fea80793ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:00.650149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea321e72-63d5-47c3-8211-1fea80793ddc service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:00.660179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 945/1899] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:00.775378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f6b383992d46f9aad3a036c6071529'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:00.789415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f6b383992d46f9aad3a036c6071529'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:00.797163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 955/1900] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:00 2022] DELETE /identity/v3/users/d9f6b383992d46f9aad3a036c6071529 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:00.801613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe637ff-88a5-49e4-8aaa-622eff613fef None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:00.801937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe637ff-88a5-49e4-8aaa-622eff613fef None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:00.802420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe637ff-88a5-49e4-8aaa-622eff613fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:00.826287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-6fe637ff-88a5-49e4-8aaa-622eff613fef None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:00.827717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6fe637ff-88a5-49e4-8aaa-622eff613fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:00.902470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 946/1901] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:00.912413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:00.913878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:00.978100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7771a-66ef-4687-8e73-e989df9c5a60 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:00.981881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3df4bd-e802-448f-aadb-b3582474407d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:00.982559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3df4bd-e802-448f-aadb-b3582474407d service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:00.982845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3df4bd-e802-448f-aadb-b3582474407d service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:00.983124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3df4bd-e802-448f-aadb-b3582474407d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:00.992244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3df4bd-e802-448f-aadb-b3582474407d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:00.993716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3df4bd-e802-448f-aadb-b3582474407d service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:01.002968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 956/1902] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:01.424107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe637ff-88a5-49e4-8aaa-622eff613fef None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:01.425488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6fe637ff-88a5-49e4-8aaa-622eff613fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:01.458276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3df4bd-e802-448f-aadb-b3582474407d service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:01.460001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5d3df4bd-e802-448f-aadb-b3582474407d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:01.473562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3df4bd-e802-448f-aadb-b3582474407d service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:01.478257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:01.479381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:01.479607 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:01.479925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] PATH_INFO: `/v3/projects/bced6326dec74e15b5adfbc906be1090` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:01.481126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bced6326dec74e15b5adfbc906be1090)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:01.483640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:01.496601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe637ff-88a5-49e4-8aaa-622eff613fef None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:01.500595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03217f-304d-4895-9fb4-ca40e8b5c3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:01.501246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03217f-304d-4895-9fb4-ca40e8b5c3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:01.501536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03217f-304d-4895-9fb4-ca40e8b5c3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:01.501817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03217f-304d-4895-9fb4-ca40e8b5c3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:01.503691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9f03217f-304d-4895-9fb4-ca40e8b5c3e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:01.568034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03217f-304d-4895-9fb4-ca40e8b5c3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:01.569562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03217f-304d-4895-9fb4-ca40e8b5c3e7 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:01.581227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 947/1903] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:01.652381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bced6326dec74e15b5adfbc906be1090', 'request_id': 'req-56ed4e59-6a35-428b-8ada-85c8c4dbad58'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:01.657723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:01.663197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bced6326dec74e15b5adfbc906be1090', 'request_id': 'req-56ed4e59-6a35-428b-8ada-85c8c4dbad58'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:01.669736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bced6326dec74e15b5adfbc906be1090', 'request_id': 'req-56ed4e59-6a35-428b-8ada-85c8c4dbad58'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:01.748256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] The token cache is being invalidate because project bced6326dec74e15b5adfbc906be1090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:01.749398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:01.749398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:01.753658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 957/1904] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:01 2022] DELETE /identity/v3/projects/bced6326dec74e15b5adfbc906be1090 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:01.754911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03217f-304d-4895-9fb4-ca40e8b5c3e7 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:01.765950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03217f-304d-4895-9fb4-ca40e8b5c3e7 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:01.833993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:01.834900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:01.835184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:01.835461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] PATH_INFO: `/v3/users/d9f8a261e432417581a0441491d710b0` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:01.836857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f8a261e432417581a0441491d710b0)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:01.838754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:02.076577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f8a261e432417581a0441491d710b0'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.077082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f8a261e432417581a0441491d710b0'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.146260 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f8a261e432417581a0441491d710b0'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.155968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f8a261e432417581a0441491d710b0'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.166371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f8a261e432417581a0441491d710b0'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.172467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 948/1905] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:01 2022] DELETE /identity/v3/users/d9f8a261e432417581a0441491d710b0 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:02.407487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:02.407487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:02.421614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed4e59-6a35-428b-8ada-85c8c4dbad58 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:02.496736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:02.497783 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:02.498127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:02.499068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] PATH_INFO: `/v3/users/d5afde58725c4b818077bdbfcb936990` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:02.500017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5afde58725c4b818077bdbfcb936990)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:02.502317 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:02.548386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:02.551585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:02.553136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:02.609704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f3f7-8b8d-4422-9266-32c77795b2a6 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:02.613291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:02.613931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:02.614210 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:02.614613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:02.616320 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:02.677139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:02.678558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:02.688858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 949/1906] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:02.719710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:02.723988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:02.736734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc10e44-953c-4915-8616-5ba501b86bbe service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:02.741693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:02.742278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:02.742569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:02.742852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] PATH_INFO: `/v3/projects/38d9d3b80c1e4ad9a4570849c4f422fd` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:02.744718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d9d3b80c1e4ad9a4570849c4f422fd)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:02.751085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:02.765831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5afde58725c4b818077bdbfcb936990'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.766555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5afde58725c4b818077bdbfcb936990'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.774071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5afde58725c4b818077bdbfcb936990'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.861716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5afde58725c4b818077bdbfcb936990'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.875872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7782c65a-0070-4e38-b86e-3a11e15f88eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5afde58725c4b818077bdbfcb936990'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.880864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d9d3b80c1e4ad9a4570849c4f422fd', 'request_id': 'req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.882435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 958/1907] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:02 2022] DELETE /identity/v3/users/d5afde58725c4b818077bdbfcb936990 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:02.886997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92857a5-e691-49eb-9cb6-68adc5a387e8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:02.887400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92857a5-e691-49eb-9cb6-68adc5a387e8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:02.888113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92857a5-e691-49eb-9cb6-68adc5a387e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:02.888699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d9d3b80c1e4ad9a4570849c4f422fd', 'request_id': 'req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.905881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e92857a5-e691-49eb-9cb6-68adc5a387e8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:02.907077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e92857a5-e691-49eb-9cb6-68adc5a387e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:02.967869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 959/1908] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:02.975263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d9d3b80c1e4ad9a4570849c4f422fd', 'request_id': 'req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.979454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92857a5-e691-49eb-9cb6-68adc5a387e8 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:02.981009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e92857a5-e691-49eb-9cb6-68adc5a387e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:02.990434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] The token cache is being invalidate because project 38d9d3b80c1e4ad9a4570849c4f422fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:02.990794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:02.991579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5ff59ab9-3b6a-4623-a07f-83a80fbde4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:03.006084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 950/1909] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:02 2022] DELETE /identity/v3/projects/38d9d3b80c1e4ad9a4570849c4f422fd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:03.007878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91cfe3-aa12-46b7-9f5e-76395688141b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.012265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91cfe3-aa12-46b7-9f5e-76395688141b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.012265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91cfe3-aa12-46b7-9f5e-76395688141b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.029546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-6d91cfe3-aa12-46b7-9f5e-76395688141b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:03.033103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6d91cfe3-aa12-46b7-9f5e-76395688141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:03.041888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 951/1910] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:03.050741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1eeb3-c612-4808-a0ea-7c1296ebf462 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.051027 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1eeb3-c612-4808-a0ea-7c1296ebf462 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.051323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1eeb3-c612-4808-a0ea-7c1296ebf462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.069751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92857a5-e691-49eb-9cb6-68adc5a387e8 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.070151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6115987-b301-40b3-9332-3e2ea1755301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.070840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6115987-b301-40b3-9332-3e2ea1755301 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.071132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6115987-b301-40b3-9332-3e2ea1755301 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.071435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6115987-b301-40b3-9332-3e2ea1755301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.073695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d6115987-b301-40b3-9332-3e2ea1755301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:03.074674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-deb1eeb3-c612-4808-a0ea-7c1296ebf462 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:03.075720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-deb1eeb3-c612-4808-a0ea-7c1296ebf462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:03.084590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 952/1911] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:03.089240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1eeb3-c612-4808-a0ea-7c1296ebf462 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:03.092470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6115987-b301-40b3-9332-3e2ea1755301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.094176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6115987-b301-40b3-9332-3e2ea1755301 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:03.101708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1eeb3-c612-4808-a0ea-7c1296ebf462 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.109471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ba59-6589-448f-b537-c8e12d70e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.111970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ba59-6589-448f-b537-c8e12d70e501 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.111970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ba59-6589-448f-b537-c8e12d70e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.111970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ba59-6589-448f-b537-c8e12d70e501 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.111970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ba59-6589-448f-b537-c8e12d70e501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:03.113586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 960/1912] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:03.113674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ba59-6589-448f-b537-c8e12d70e501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.114129 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ba59-6589-448f-b537-c8e12d70e501 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:03.131435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 953/1913] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:41:03.132507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6115987-b301-40b3-9332-3e2ea1755301 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:03.142841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6115987-b301-40b3-9332-3e2ea1755301 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.147816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947a95e-20ad-43b8-b45e-42f308fc5585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.148520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947a95e-20ad-43b8-b45e-42f308fc5585 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.148808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947a95e-20ad-43b8-b45e-42f308fc5585 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.149081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947a95e-20ad-43b8-b45e-42f308fc5585 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.150509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947a95e-20ad-43b8-b45e-42f308fc5585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.152510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947a95e-20ad-43b8-b45e-42f308fc5585 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:03.261735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 961/1914] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:03 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:03.264415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ba59-6589-448f-b537-c8e12d70e501 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:03.272910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ba59-6589-448f-b537-c8e12d70e501 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.336229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146807-e6ba-4ecd-9c11-02adcf2d1e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.337133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146807-e6ba-4ecd-9c11-02adcf2d1e8f admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.338042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146807-e6ba-4ecd-9c11-02adcf2d1e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.338414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146807-e6ba-4ecd-9c11-02adcf2d1e8f admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.339273 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146807-e6ba-4ecd-9c11-02adcf2d1e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.341287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146807-e6ba-4ecd-9c11-02adcf2d1e8f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:03.501418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 954/1915] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:03 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:03.512294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947a95e-20ad-43b8-b45e-42f308fc5585 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:03.522284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947a95e-20ad-43b8-b45e-42f308fc5585 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.529764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7337e37-7313-4bc3-848e-2c28d4d1fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.530865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7337e37-7313-4bc3-848e-2c28d4d1fa8b admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.531294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7337e37-7313-4bc3-848e-2c28d4d1fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.531577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7337e37-7313-4bc3-848e-2c28d4d1fa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.532406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7337e37-7313-4bc3-848e-2c28d4d1fa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.536898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7337e37-7313-4bc3-848e-2c28d4d1fa8b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:03.548992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 962/1916] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:03.553090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146807-e6ba-4ecd-9c11-02adcf2d1e8f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:03.563455 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146807-e6ba-4ecd-9c11-02adcf2d1e8f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.568274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e57d1-0d10-4d7e-98d0-a42748b171bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.568930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e57d1-0d10-4d7e-98d0-a42748b171bf admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.569213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e57d1-0d10-4d7e-98d0-a42748b171bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.569490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e57d1-0d10-4d7e-98d0-a42748b171bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.570213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e57d1-0d10-4d7e-98d0-a42748b171bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.572477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e57d1-0d10-4d7e-98d0-a42748b171bf admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:03.587128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 955/1917] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:03.594545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7337e37-7313-4bc3-848e-2c28d4d1fa8b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:03.605388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7337e37-7313-4bc3-848e-2c28d4d1fa8b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.610709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd057f-4cdb-44cc-9239-f8f83d803df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.611588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd057f-4cdb-44cc-9239-f8f83d803df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.612482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd057f-4cdb-44cc-9239-f8f83d803df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.612482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd057f-4cdb-44cc-9239-f8f83d803df5 admin admin] PATH_INFO: `/v3/projects/e1818cb49e1d463d90f501cb934938d0/users/a0a0c8915f804435a99fd3eda3cafbdd/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.630316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd057f-4cdb-44cc-9239-f8f83d803df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1818cb49e1d463d90f501cb934938d0, user_id=a0a0c8915f804435a99fd3eda3cafbdd, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.634544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e57d1-0d10-4d7e-98d0-a42748b171bf admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:03.637577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-575e57d1-0d10-4d7e-98d0-a42748b171bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:03.646061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd057f-4cdb-44cc-9239-f8f83d803df5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:03.653908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e57d1-0d10-4d7e-98d0-a42748b171bf admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.663509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.663509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.663509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.663509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] PATH_INFO: `/v3/projects/41135cf16b7a4b91b43db0e230f1078e` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.664124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41135cf16b7a4b91b43db0e230f1078e)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.664772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:03.748487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 963/1918] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:03 2022] PUT /identity/v3/projects/e1818cb49e1d463d90f501cb934938d0/users/a0a0c8915f804435a99fd3eda3cafbdd/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:03.760556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64494a16-f029-4c97-a9e9-77dd5672b308 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.760851 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64494a16-f029-4c97-a9e9-77dd5672b308 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.761128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64494a16-f029-4c97-a9e9-77dd5672b308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.771409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:03.788647 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-64494a16-f029-4c97-a9e9-77dd5672b308 None None] MFA Rules not processed for user `a0a0c8915f804435a99fd3eda3cafbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:03.789088 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41135cf16b7a4b91b43db0e230f1078e', 'request_id': 'req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:03.789858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-64494a16-f029-4c97-a9e9-77dd5672b308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:03.796290 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41135cf16b7a4b91b43db0e230f1078e', 'request_id': 'req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:03.854075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 964/1919] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:03.858356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64494a16-f029-4c97-a9e9-77dd5672b308 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:03.913026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41135cf16b7a4b91b43db0e230f1078e', 'request_id': 'req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:03.917551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64494a16-f029-4c97-a9e9-77dd5672b308 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.921923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266040b-e780-4afa-8793-5ea699e2c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.922573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266040b-e780-4afa-8793-5ea699e2c32a admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.922854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266040b-e780-4afa-8793-5ea699e2c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.923136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266040b-e780-4afa-8793-5ea699e2c32a admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.923870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266040b-e780-4afa-8793-5ea699e2c32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.924977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] The token cache is being invalidate because project 41135cf16b7a4b91b43db0e230f1078e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:03.925277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:03.925839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266040b-e780-4afa-8793-5ea699e2c32a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:03.925969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:03.927708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 956/1920] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:03 2022] DELETE /identity/v3/projects/41135cf16b7a4b91b43db0e230f1078e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:03.932442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:03.934267 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:03.948254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5da3d-b23f-41f4-8f27-b7c03ca8636c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:03.953287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:03.954142 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:03.954419 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:03.954692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] PATH_INFO: `/v3/users/dd06c102f4434c3493294ba4795de53a` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:03.955915 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd06c102f4434c3493294ba4795de53a)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:03.957838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:04.056733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 965/1921] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:03 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:04.057718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266040b-e780-4afa-8793-5ea699e2c32a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:04.059451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a266040b-e780-4afa-8793-5ea699e2c32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:04.123617 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266040b-e780-4afa-8793-5ea699e2c32a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:04.128532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d7f46-9ec3-4889-960e-4f48886fdeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:04.129344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d7f46-9ec3-4889-960e-4f48886fdeea admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:04.129623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d7f46-9ec3-4889-960e-4f48886fdeea admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:04.129901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d7f46-9ec3-4889-960e-4f48886fdeea admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:04.130612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d7f46-9ec3-4889-960e-4f48886fdeea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:04.132639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d7f46-9ec3-4889-960e-4f48886fdeea admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:04.189904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd06c102f4434c3493294ba4795de53a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:04.190673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd06c102f4434c3493294ba4795de53a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:04.205185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:04.271753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 966/1922] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:04 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:04.273141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d7f46-9ec3-4889-960e-4f48886fdeea admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:04.284359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d7f46-9ec3-4889-960e-4f48886fdeea admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:04.289060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f954ace-4d2a-44e3-a63d-67b19723111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:04.289718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f954ace-4d2a-44e3-a63d-67b19723111e admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:04.290004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f954ace-4d2a-44e3-a63d-67b19723111e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:04.290784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f954ace-4d2a-44e3-a63d-67b19723111e admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:04.291499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f954ace-4d2a-44e3-a63d-67b19723111e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:04.293146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f954ace-4d2a-44e3-a63d-67b19723111e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:04.296717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd06c102f4434c3493294ba4795de53a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:04.304375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd06c102f4434c3493294ba4795de53a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:04.305095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 967/1923] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:04.309741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f954ace-4d2a-44e3-a63d-67b19723111e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:04.316959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd06c102f4434c3493294ba4795de53a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:04.319796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f954ace-4d2a-44e3-a63d-67b19723111e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:04.323298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 957/1924] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:03 2022] DELETE /identity/v3/users/dd06c102f4434c3493294ba4795de53a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:04.324586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48441d-c86b-4ea0-a3b4-7d9dc3f7e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:04.325493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48441d-c86b-4ea0-a3b4-7d9dc3f7e2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:04.329438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48441d-c86b-4ea0-a3b4-7d9dc3f7e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:04.329438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48441d-c86b-4ea0-a3b4-7d9dc3f7e2ee admin admin] PATH_INFO: `/v3/projects/e84d2668f10c41e88ca78bbd5ffe11ae/users/185edee65dae4de6a8bb0df8d3639659/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:04.342518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48441d-c86b-4ea0-a3b4-7d9dc3f7e2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84d2668f10c41e88ca78bbd5ffe11ae, user_id=185edee65dae4de6a8bb0df8d3639659, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:04.345392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48441d-c86b-4ea0-a3b4-7d9dc3f7e2ee admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:04.451325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 968/1925] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:04 2022] PUT /identity/v3/projects/e84d2668f10c41e88ca78bbd5ffe11ae/users/185edee65dae4de6a8bb0df8d3639659/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:04.455396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:04.456833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:04.521731 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31242aa8-5804-40db-b750-d0a3e8dd64fd admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:04.585063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b377ebf-4456-4626-86ba-68bf19b1003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:04.585744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b377ebf-4456-4626-86ba-68bf19b1003b admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:04.586096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b377ebf-4456-4626-86ba-68bf19b1003b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:04.586313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b377ebf-4456-4626-86ba-68bf19b1003b admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:04.587593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b377ebf-4456-4626-86ba-68bf19b1003b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:04.589260 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b377ebf-4456-4626-86ba-68bf19b1003b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:04.600577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 958/1926] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:04.605296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48441d-c86b-4ea0-a3b4-7d9dc3f7e2ee admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:04.615756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48441d-c86b-4ea0-a3b4-7d9dc3f7e2ee admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:04.620525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abbfb9-0b4c-465b-adbe-9e48c8050769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:04.621415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abbfb9-0b4c-465b-adbe-9e48c8050769 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:04.621724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abbfb9-0b4c-465b-adbe-9e48c8050769 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:04.621980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abbfb9-0b4c-465b-adbe-9e48c8050769 admin admin] PATH_INFO: `/v3/projects/e84d2668f10c41e88ca78bbd5ffe11ae/users/185edee65dae4de6a8bb0df8d3639659/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:04.624033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abbfb9-0b4c-465b-adbe-9e48c8050769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84d2668f10c41e88ca78bbd5ffe11ae, user_id=185edee65dae4de6a8bb0df8d3639659, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:04.626725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abbfb9-0b4c-465b-adbe-9e48c8050769 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:04.638215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 969/1927] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:04 2022] PUT /identity/v3/projects/e84d2668f10c41e88ca78bbd5ffe11ae/users/185edee65dae4de6a8bb0df8d3639659/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:04.648100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5bece-1ac2-4c0c-9bdc-ff051cd31ebe None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:04.648568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5bece-1ac2-4c0c-9bdc-ff051cd31ebe None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:04.648676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5bece-1ac2-4c0c-9bdc-ff051cd31ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:04.676062 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-18e5bece-1ac2-4c0c-9bdc-ff051cd31ebe None None] MFA Rules not processed for user `185edee65dae4de6a8bb0df8d3639659`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:04.677270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-18e5bece-1ac2-4c0c-9bdc-ff051cd31ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:04.770656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abbfb9-0b4c-465b-adbe-9e48c8050769 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:04.776438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 959/1928] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:04.777151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b8abbfb9-0b4c-465b-adbe-9e48c8050769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:04.790287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5bece-1ac2-4c0c-9bdc-ff051cd31ebe None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:04.791907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-18e5bece-1ac2-4c0c-9bdc-ff051cd31ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:04.890219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5bece-1ac2-4c0c-9bdc-ff051cd31ebe None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:04.894474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419eed0-07c4-48b8-9ab1-bed953bd9072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:04.895157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419eed0-07c4-48b8-9ab1-bed953bd9072 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:04.895481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419eed0-07c4-48b8-9ab1-bed953bd9072 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:04.896172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419eed0-07c4-48b8-9ab1-bed953bd9072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:04.909647 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419eed0-07c4-48b8-9ab1-bed953bd9072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:04.911244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419eed0-07c4-48b8-9ab1-bed953bd9072 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:04.924106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 960/1929] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:04.943482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abbfb9-0b4c-465b-adbe-9e48c8050769 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:04.964637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:04.964637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:04.964637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:04.964637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] PATH_INFO: `/v3/projects/4367046b26a74f9e9b5741dd9ce2d31a` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:04.970479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4367046b26a74f9e9b5741dd9ce2d31a)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:04.972772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:05.097992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4367046b26a74f9e9b5741dd9ce2d31a', 'request_id': 'req-c3ee3df9-3397-4871-b351-1a5936fd6acb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:05.103866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4367046b26a74f9e9b5741dd9ce2d31a', 'request_id': 'req-c3ee3df9-3397-4871-b351-1a5936fd6acb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:05.110758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4367046b26a74f9e9b5741dd9ce2d31a', 'request_id': 'req-c3ee3df9-3397-4871-b351-1a5936fd6acb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:05.232577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] The token cache is being invalidate because project 4367046b26a74f9e9b5741dd9ce2d31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:05.232865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:05.233528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c3ee3df9-3397-4871-b351-1a5936fd6acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:05.235075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 970/1930] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:04 2022] DELETE /identity/v3/projects/4367046b26a74f9e9b5741dd9ce2d31a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:05.239978 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212bae-92cd-487d-8b73-d7aef5298689 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:05.240264 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212bae-92cd-487d-8b73-d7aef5298689 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:05.240540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212bae-92cd-487d-8b73-d7aef5298689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:05.260505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-88212bae-92cd-487d-8b73-d7aef5298689 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:05.261989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-88212bae-92cd-487d-8b73-d7aef5298689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:05.320954 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 961/1931] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:05.329362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7a4c7-753d-4a90-ba10-2985105fa3d2 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:05.329654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7a4c7-753d-4a90-ba10-2985105fa3d2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:05.329940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7a4c7-753d-4a90-ba10-2985105fa3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:05.350134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-dea7a4c7-753d-4a90-ba10-2985105fa3d2 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:05.351338 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dea7a4c7-753d-4a90-ba10-2985105fa3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:05.359471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 971/1932] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:05.363709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212bae-92cd-487d-8b73-d7aef5298689 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:05.374429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212bae-92cd-487d-8b73-d7aef5298689 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:05.379083 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf60c6-ffd3-45a2-ad4f-ccc51b8c79eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:05.379774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf60c6-ffd3-45a2-ad4f-ccc51b8c79eb admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:05.380060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf60c6-ffd3-45a2-ad4f-ccc51b8c79eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:05.380340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf60c6-ffd3-45a2-ad4f-ccc51b8c79eb admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:05.381163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf60c6-ffd3-45a2-ad4f-ccc51b8c79eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:05.381390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf60c6-ffd3-45a2-ad4f-ccc51b8c79eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:05.382971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf60c6-ffd3-45a2-ad4f-ccc51b8c79eb admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:05.395754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 962/1933] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:41:05.400236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7a4c7-753d-4a90-ba10-2985105fa3d2 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:05.409635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7a4c7-753d-4a90-ba10-2985105fa3d2 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:05.414325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3d642-fdd1-4332-b0f8-64909f9bf8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:05.415006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3d642-fdd1-4332-b0f8-64909f9bf8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:05.415444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3d642-fdd1-4332-b0f8-64909f9bf8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:05.415756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3d642-fdd1-4332-b0f8-64909f9bf8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:05.416436 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3d642-fdd1-4332-b0f8-64909f9bf8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:05.418336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3d642-fdd1-4332-b0f8-64909f9bf8f6 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:05.572715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 972/1934] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:05 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:05.576841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf60c6-ffd3-45a2-ad4f-ccc51b8c79eb admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:05.599144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf60c6-ffd3-45a2-ad4f-ccc51b8c79eb admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:05.670972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2086b03-1ca0-4639-a231-8202a4b26417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:05.677236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2086b03-1ca0-4639-a231-8202a4b26417 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:05.677236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2086b03-1ca0-4639-a231-8202a4b26417 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:05.677236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2086b03-1ca0-4639-a231-8202a4b26417 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:05.677236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2086b03-1ca0-4639-a231-8202a4b26417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:05.677236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2086b03-1ca0-4639-a231-8202a4b26417 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:05.815167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 963/1935] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:05 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:05.816478 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3d642-fdd1-4332-b0f8-64909f9bf8f6 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:05.827379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3d642-fdd1-4332-b0f8-64909f9bf8f6 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:05.832426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84b7a5-4b82-4b37-b0d2-a971d3b26dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:05.834346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84b7a5-4b82-4b37-b0d2-a971d3b26dae admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:05.834643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84b7a5-4b82-4b37-b0d2-a971d3b26dae admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:05.835278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84b7a5-4b82-4b37-b0d2-a971d3b26dae admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:05.836051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84b7a5-4b82-4b37-b0d2-a971d3b26dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:05.838820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84b7a5-4b82-4b37-b0d2-a971d3b26dae admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:05.852356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 973/1936] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:05.857061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2086b03-1ca0-4639-a231-8202a4b26417 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:05.866991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2086b03-1ca0-4639-a231-8202a4b26417 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:05.872109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8e2ca-9115-49c5-a0e9-28790939e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:05.872891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8e2ca-9115-49c5-a0e9-28790939e0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:05.880405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8e2ca-9115-49c5-a0e9-28790939e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:05.880405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8e2ca-9115-49c5-a0e9-28790939e0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:05.880405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8e2ca-9115-49c5-a0e9-28790939e0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:05.880405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8e2ca-9115-49c5-a0e9-28790939e0d7 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:05.885994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 964/1937] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:05.890385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84b7a5-4b82-4b37-b0d2-a971d3b26dae admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:05.901188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84b7a5-4b82-4b37-b0d2-a971d3b26dae admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:05.905279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ea93-e089-4d27-9c4d-9fe03fcb84c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:05.906139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ea93-e089-4d27-9c4d-9fe03fcb84c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:05.906419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ea93-e089-4d27-9c4d-9fe03fcb84c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:05.906694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ea93-e089-4d27-9c4d-9fe03fcb84c8 admin admin] PATH_INFO: `/v3/projects/99927aef2b994e8180bb1d1868177084/users/45609dab242747448af5326fd14f0037/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:05.921594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9ea93-e089-4d27-9c4d-9fe03fcb84c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99927aef2b994e8180bb1d1868177084, user_id=45609dab242747448af5326fd14f0037, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:05.924265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9ea93-e089-4d27-9c4d-9fe03fcb84c8 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:06.092824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 974/1938] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:05 2022] PUT /identity/v3/projects/99927aef2b994e8180bb1d1868177084/users/45609dab242747448af5326fd14f0037/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:06.104019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d393dc-6ca4-4d14-b487-5ec1ef4b959f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:06.104314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d393dc-6ca4-4d14-b487-5ec1ef4b959f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:06.104599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d393dc-6ca4-4d14-b487-5ec1ef4b959f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:06.138218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-e1d393dc-6ca4-4d14-b487-5ec1ef4b959f None None] MFA Rules not processed for user `45609dab242747448af5326fd14f0037`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:06.139707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e1d393dc-6ca4-4d14-b487-5ec1ef4b959f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:06.215453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ea93-e089-4d27-9c4d-9fe03fcb84c8 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:06.217268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e1f9ea93-e089-4d27-9c4d-9fe03fcb84c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:06.224444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 965/1939] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:06.229104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d393dc-6ca4-4d14-b487-5ec1ef4b959f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:06.297904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ea93-e089-4d27-9c4d-9fe03fcb84c8 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:06.303477 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006195d4-8fbf-433c-9ec2-d9e70d992962 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '185edee65dae4de6a8bb0df8d3639659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e84d2668f10c41e88ca78bbd5ffe11ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:06.304242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006195d4-8fbf-433c-9ec2-d9e70d992962 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:06.304527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006195d4-8fbf-433c-9ec2-d9e70d992962 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:06.304802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006195d4-8fbf-433c-9ec2-d9e70d992962 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:06.305686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006195d4-8fbf-433c-9ec2-d9e70d992962 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:06.306004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006195d4-8fbf-433c-9ec2-d9e70d992962 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:06.307698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006195d4-8fbf-433c-9ec2-d9e70d992962 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:06.327177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d393dc-6ca4-4d14-b487-5ec1ef4b959f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:06.332346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 975/1940] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:41:06.336815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006195d4-8fbf-433c-9ec2-d9e70d992962 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:06.338541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5f76e-d83e-4b41-a6b4-b71dead9de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:06.339230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f76e-d83e-4b41-a6b4-b71dead9de43 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:06.339519 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f76e-d83e-4b41-a6b4-b71dead9de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:06.339889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f76e-d83e-4b41-a6b4-b71dead9de43 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:06.346370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5f76e-d83e-4b41-a6b4-b71dead9de43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:06.346370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5f76e-d83e-4b41-a6b4-b71dead9de43 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:06.362560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006195d4-8fbf-433c-9ec2-d9e70d992962 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:06.371128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203d114-bc75-448a-b2c8-84d08b21e1e4 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '185edee65dae4de6a8bb0df8d3639659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e84d2668f10c41e88ca78bbd5ffe11ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:06.372017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203d114-bc75-448a-b2c8-84d08b21e1e4 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:06.372314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203d114-bc75-448a-b2c8-84d08b21e1e4 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:06.376158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203d114-bc75-448a-b2c8-84d08b21e1e4 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:06.376158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203d114-bc75-448a-b2c8-84d08b21e1e4 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:06.376158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203d114-bc75-448a-b2c8-84d08b21e1e4 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:06.400977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:06.457714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 966/1941] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:06 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:06.461855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5f76e-d83e-4b41-a6b4-b71dead9de43 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:06.483140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 976/1942] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:06 2022] POST /identity/v3/projects => generated 353 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:06.487698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203d114-bc75-448a-b2c8-84d08b21e1e4 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:06.536885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5f76e-d83e-4b41-a6b4-b71dead9de43 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:06.568854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203d114-bc75-448a-b2c8-84d08b21e1e4 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:06.575140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180f5b6-096d-479c-b2d9-964c38ceb521 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '185edee65dae4de6a8bb0df8d3639659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e84d2668f10c41e88ca78bbd5ffe11ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:06.575984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180f5b6-096d-479c-b2d9-964c38ceb521 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:06.576343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180f5b6-096d-479c-b2d9-964c38ceb521 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:06.576705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180f5b6-096d-479c-b2d9-964c38ceb521 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:06.577536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180f5b6-096d-479c-b2d9-964c38ceb521 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:06.577924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180f5b6-096d-479c-b2d9-964c38ceb521 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:06.589826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180f5b6-096d-479c-b2d9-964c38ceb521 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:06.593776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 977/1943] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:06.622426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b81b-264d-4cc4-adfa-d8f10c282d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:06.623123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b81b-264d-4cc4-adfa-d8f10c282d6e admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:06.623410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b81b-264d-4cc4-adfa-d8f10c282d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:06.623692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b81b-264d-4cc4-adfa-d8f10c282d6e admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:06.624535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8b81b-264d-4cc4-adfa-d8f10c282d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:06.626684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8b81b-264d-4cc4-adfa-d8f10c282d6e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:06.646658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180f5b6-096d-479c-b2d9-964c38ceb521 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:06.658129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180f5b6-096d-479c-b2d9-964c38ceb521 tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:06.669055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '185edee65dae4de6a8bb0df8d3639659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e84d2668f10c41e88ca78bbd5ffe11ae', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:06.670151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:06.670474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:06.673411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] PATH_INFO: `/v3/projects/0dfe36025d5e4a2f8b69c1be52fedf93` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:06.673411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0dfe36025d5e4a2f8b69c1be52fedf93)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:06.673939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:06.763471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 967/1944] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:06 2022] POST /identity/v3/users => generated 300 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:06.764601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b81b-264d-4cc4-adfa-d8f10c282d6e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:06.775690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b81b-264d-4cc4-adfa-d8f10c282d6e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:06.780287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b089-badf-4487-8c27-038b258713ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:06.780950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b089-badf-4487-8c27-038b258713ca admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:06.781239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b089-badf-4487-8c27-038b258713ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:06.781522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b089-badf-4487-8c27-038b258713ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:06.782244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b089-badf-4487-8c27-038b258713ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:06.783875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b089-badf-4487-8c27-038b258713ca admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:06.797880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 968/1945] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:06.800265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b089-badf-4487-8c27-038b258713ca admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:06.810666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b089-badf-4487-8c27-038b258713ca admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:06.816695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbfb3f-49d4-4506-8e0e-4845a91e09d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:06.817581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbfb3f-49d4-4506-8e0e-4845a91e09d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:06.817860 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbfb3f-49d4-4506-8e0e-4845a91e09d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:06.818132 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbfb3f-49d4-4506-8e0e-4845a91e09d3 admin admin] PATH_INFO: `/v3/projects/fc2e6ce9193f4ae687497aa30da600ec/users/fa438f0a46d84d498a2261093e31caa2/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:06.837015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbfb3f-49d4-4506-8e0e-4845a91e09d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2e6ce9193f4ae687497aa30da600ec, user_id=fa438f0a46d84d498a2261093e31caa2, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:06.841540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbfb3f-49d4-4506-8e0e-4845a91e09d3 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:06.982150 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:07.028732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 969/1946] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:06 2022] PUT /identity/v3/projects/fc2e6ce9193f4ae687497aa30da600ec/users/fa438f0a46d84d498a2261093e31caa2/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:07.032843 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbfb3f-49d4-4506-8e0e-4845a91e09d3 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:07.056695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfe36025d5e4a2f8b69c1be52fedf93', 'request_id': 'req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.073984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfe36025d5e4a2f8b69c1be52fedf93', 'request_id': 'req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.100185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfe36025d5e4a2f8b69c1be52fedf93', 'request_id': 'req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.140255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbfb3f-49d4-4506-8e0e-4845a91e09d3 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:07.196545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026df6f2-4d7b-4540-b8f4-65275452f4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:07.197276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026df6f2-4d7b-4540-b8f4-65275452f4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:07.197572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026df6f2-4d7b-4540-b8f4-65275452f4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:07.197845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026df6f2-4d7b-4540-b8f4-65275452f4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:07.198575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026df6f2-4d7b-4540-b8f4-65275452f4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:07.200224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026df6f2-4d7b-4540-b8f4-65275452f4a8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:07.209937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] The token cache is being invalidate because project 0dfe36025d5e4a2f8b69c1be52fedf93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:07.210229 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.211124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.213036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 978/1947] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:06 2022] DELETE /identity/v3/projects/0dfe36025d5e4a2f8b69c1be52fedf93 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:07.214135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:07.217426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:07.223288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 970/1948] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:07.228549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026df6f2-4d7b-4540-b8f4-65275452f4a8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:07.230993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-026df6f2-4d7b-4540-b8f4-65275452f4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:07.231831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb4f5-1d7a-42d4-9085-f3842ad3555d tempest-VolumeQuotaClassesTest-1085183621 tempest-VolumeQuotaClassesTest-1085183621-project-admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:07.237034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:07.238187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:07.238684 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:07.239374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] PATH_INFO: `/v3/users/eca6d3b71ecf4033b94232c4963abe2e` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:07.240911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca6d3b71ecf4033b94232c4963abe2e)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:07.243987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:07.247850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026df6f2-4d7b-4540-b8f4-65275452f4a8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:07.255452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d204de0-bbcf-4bae-b082-4b5cafb1a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:07.257029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d204de0-bbcf-4bae-b082-4b5cafb1a37a admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:07.266706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d204de0-bbcf-4bae-b082-4b5cafb1a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:07.266706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d204de0-bbcf-4bae-b082-4b5cafb1a37a admin admin] PATH_INFO: `/v3/projects/fc2e6ce9193f4ae687497aa30da600ec/users/fa438f0a46d84d498a2261093e31caa2/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:07.266706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d204de0-bbcf-4bae-b082-4b5cafb1a37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2e6ce9193f4ae687497aa30da600ec, user_id=fa438f0a46d84d498a2261093e31caa2, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:07.266706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d204de0-bbcf-4bae-b082-4b5cafb1a37a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:07.288859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 971/1949] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:07 2022] PUT /identity/v3/projects/fc2e6ce9193f4ae687497aa30da600ec/users/fa438f0a46d84d498a2261093e31caa2/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:07.299892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fc99b-21e0-4285-be15-89f949d00676 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:07.300607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fc99b-21e0-4285-be15-89f949d00676 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:07.301314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fc99b-21e0-4285-be15-89f949d00676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:07.340169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-018fc99b-21e0-4285-be15-89f949d00676 None None] MFA Rules not processed for user `fa438f0a46d84d498a2261093e31caa2`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:07.341536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-018fc99b-21e0-4285-be15-89f949d00676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:07.452004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 972/1950] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:07.467251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fc99b-21e0-4285-be15-89f949d00676 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:07.468744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-018fc99b-21e0-4285-be15-89f949d00676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:07.516285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca6d3b71ecf4033b94232c4963abe2e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.519112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca6d3b71ecf4033b94232c4963abe2e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.534378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca6d3b71ecf4033b94232c4963abe2e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.542487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fc99b-21e0-4285-be15-89f949d00676 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:07.547965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8ae1e-4b0b-4a8e-ac62-88d600e1172c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:07.548805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ae1e-4b0b-4a8e-ac62-88d600e1172c service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:07.549101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ae1e-4b0b-4a8e-ac62-88d600e1172c service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:07.549374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ae1e-4b0b-4a8e-ac62-88d600e1172c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:07.561249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8ae1e-4b0b-4a8e-ac62-88d600e1172c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:07.563473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8ae1e-4b0b-4a8e-ac62-88d600e1172c service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:07.572989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 973/1951] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:07.601214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8ae1e-4b0b-4a8e-ac62-88d600e1172c service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:07.607696 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca6d3b71ecf4033b94232c4963abe2e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.622355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1e10bfd0-a76f-463b-9f97-fb0002f38cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca6d3b71ecf4033b94232c4963abe2e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.631299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 979/1952] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:07 2022] DELETE /identity/v3/users/eca6d3b71ecf4033b94232c4963abe2e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:07.632890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f077c-aed3-4b03-95e8-e2af3f6e9f45 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:07.633180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f077c-aed3-4b03-95e8-e2af3f6e9f45 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:07.633482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f077c-aed3-4b03-95e8-e2af3f6e9f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:07.651446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-8f3f077c-aed3-4b03-95e8-e2af3f6e9f45 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:07.652622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8f3f077c-aed3-4b03-95e8-e2af3f6e9f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:07.671198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8ae1e-4b0b-4a8e-ac62-88d600e1172c service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:07.710347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 980/1953] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:07.720565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f077c-aed3-4b03-95e8-e2af3f6e9f45 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:07.722320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8f3f077c-aed3-4b03-95e8-e2af3f6e9f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:07.729293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:07.732138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:07.732138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:07.732138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] PATH_INFO: `/v3/users/45609dab242747448af5326fd14f0037` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:07.732407 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45609dab242747448af5326fd14f0037)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:07.734253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:07.838575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f077c-aed3-4b03-95e8-e2af3f6e9f45 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:07.848682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2599f02-b369-43fe-a272-595e1636daef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:07.849362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2599f02-b369-43fe-a272-595e1636daef service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:07.849713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2599f02-b369-43fe-a272-595e1636daef service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:07.849979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2599f02-b369-43fe-a272-595e1636daef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:07.864646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2599f02-b369-43fe-a272-595e1636daef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:07.866572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2599f02-b369-43fe-a272-595e1636daef service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:07.903941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 981/1954] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:07.965154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45609dab242747448af5326fd14f0037'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:07.966040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45609dab242747448af5326fd14f0037'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.056130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45609dab242747448af5326fd14f0037'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.068491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45609dab242747448af5326fd14f0037'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.082062 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2599f02-b369-43fe-a272-595e1636daef service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:08.084240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f2599f02-b369-43fe-a272-595e1636daef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:08.093098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a90b0342-d379-4fd0-9d87-3053283a8da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45609dab242747448af5326fd14f0037'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.105169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 974/1955] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:07 2022] DELETE /identity/v3/users/45609dab242747448af5326fd14f0037 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:08.109571 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29f8b2-df57-4a76-81ce-34f7e97a491e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:08.109926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29f8b2-df57-4a76-81ce-34f7e97a491e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:08.110235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29f8b2-df57-4a76-81ce-34f7e97a491e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:08.119536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2599f02-b369-43fe-a272-595e1636daef service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:08.142486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9b29f8b2-df57-4a76-81ce-34f7e97a491e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:08.142486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9b29f8b2-df57-4a76-81ce-34f7e97a491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:08.217872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 975/1956] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:08.218988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29f8b2-df57-4a76-81ce-34f7e97a491e None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:08.223091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9b29f8b2-df57-4a76-81ce-34f7e97a491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:08.227566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:08.229381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:08.229706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:08.230278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] PATH_INFO: `/v3/users/a0a0c8915f804435a99fd3eda3cafbdd` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:08.232025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a0c8915f804435a99fd3eda3cafbdd)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:08.234105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:08.244382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29f8b2-df57-4a76-81ce-34f7e97a491e None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:08.250511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:08.251458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:08.251764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:08.252070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] PATH_INFO: `/v3/users/d90c7a28515c4feb93d4f088a7017fca` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:08.253532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90c7a28515c4feb93d4f088a7017fca)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:08.255849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:08.492566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a0c8915f804435a99fd3eda3cafbdd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.493785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a0c8915f804435a99fd3eda3cafbdd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.500779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a0c8915f804435a99fd3eda3cafbdd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.584615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90c7a28515c4feb93d4f088a7017fca'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.585327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90c7a28515c4feb93d4f088a7017fca'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.593439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a0c8915f804435a99fd3eda3cafbdd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.609908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a0c8915f804435a99fd3eda3cafbdd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.617123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 982/1957] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:08 2022] DELETE /identity/v3/users/a0a0c8915f804435a99fd3eda3cafbdd => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:08.618177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:08.620093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:08.691389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cd7b9-807a-48e6-9ed1-913193667bcf admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:08.696333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81610c65-f2c5-4b9f-b24c-da1a12b59a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:08.697002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81610c65-f2c5-4b9f-b24c-da1a12b59a26 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:08.697282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81610c65-f2c5-4b9f-b24c-da1a12b59a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:08.697502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90c7a28515c4feb93d4f088a7017fca'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.697608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81610c65-f2c5-4b9f-b24c-da1a12b59a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:08.699669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-81610c65-f2c5-4b9f-b24c-da1a12b59a26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:08.708268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90c7a28515c4feb93d4f088a7017fca'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.728854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90c7a28515c4feb93d4f088a7017fca'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:08.737596 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 976/1958] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:08 2022] DELETE /identity/v3/users/d90c7a28515c4feb93d4f088a7017fca => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:08.741836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:08.744258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:08.826016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81610c65-f2c5-4b9f-b24c-da1a12b59a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:08.828009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81610c65-f2c5-4b9f-b24c-da1a12b59a26 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:08.829417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1483b4e-ab22-47b5-a3e5-be1e2f770576 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:08.834617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:08.835528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:08.835847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:08.836183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] PATH_INFO: `/v3/projects/8b35c69cbc8f4701964cf9a84990d017` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:08.838014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b35c69cbc8f4701964cf9a84990d017)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:08.840003 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:08.844433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 983/1959] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:08.846357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6eff5-76d2-40ae-94e7-c16d89a21d6d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:08.846928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6eff5-76d2-40ae-94e7-c16d89a21d6d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:08.847361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6eff5-76d2-40ae-94e7-c16d89a21d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:08.871007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:08.876422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a8c6eff5-76d2-40ae-94e7-c16d89a21d6d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:08.878367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a8c6eff5-76d2-40ae-94e7-c16d89a21d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:08.888611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 984/1960] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:08.889875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3e8fd-23ab-4016-aed4-f1280cfcae4d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:08.890169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3e8fd-23ab-4016-aed4-f1280cfcae4d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:08.890570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3e8fd-23ab-4016-aed4-f1280cfcae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:08.913894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4be3e8fd-23ab-4016-aed4-f1280cfcae4d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:08.918006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4be3e8fd-23ab-4016-aed4-f1280cfcae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:08.923840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 985/1961] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:08.924671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3e8fd-23ab-4016-aed4-f1280cfcae4d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:08.925980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4be3e8fd-23ab-4016-aed4-f1280cfcae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:09.004197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3e8fd-23ab-4016-aed4-f1280cfcae4d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:09.004597 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b35c69cbc8f4701964cf9a84990d017', 'request_id': 'req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.016457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b35c69cbc8f4701964cf9a84990d017', 'request_id': 'req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.073942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbe147-ce2d-4dd6-b349-855d01053c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:09.074867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbe147-ce2d-4dd6-b349-855d01053c1f service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:09.075496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbe147-ce2d-4dd6-b349-855d01053c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:09.075973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbe147-ce2d-4dd6-b349-855d01053c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:09.102238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b35c69cbc8f4701964cf9a84990d017', 'request_id': 'req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.114655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] The token cache is being invalidate because project 8b35c69cbc8f4701964cf9a84990d017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:09.115011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.115697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.120686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 977/1962] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:08 2022] DELETE /identity/v3/projects/8b35c69cbc8f4701964cf9a84990d017 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:09.120686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:09.121374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:09.142432 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eae1ce-79ca-4ff0-9daa-531d8a9710ff admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:09.147311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ed57d-e166-4586-b7ac-17c89caf63bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:09.148453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ed57d-e166-4586-b7ac-17c89caf63bf service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:09.149181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ed57d-e166-4586-b7ac-17c89caf63bf service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:09.150511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ed57d-e166-4586-b7ac-17c89caf63bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:09.153663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7e8ed57d-e166-4586-b7ac-17c89caf63bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:09.158956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbe147-ce2d-4dd6-b349-855d01053c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:09.161104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbe147-ce2d-4dd6-b349-855d01053c1f service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:09.170338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ed57d-e166-4586-b7ac-17c89caf63bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:09.176147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ed57d-e166-4586-b7ac-17c89caf63bf service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:09.176386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 986/1963] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:09.176386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbe147-ce2d-4dd6-b349-855d01053c1f service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:09.186173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbe147-ce2d-4dd6-b349-855d01053c1f service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:09.191159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:09.192177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:09.192459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:09.192731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] PATH_INFO: `/v3/users/79479375549841d8a46c14555cdc80f9` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:09.194047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=79479375549841d8a46c14555cdc80f9)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:09.196712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:09.221704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 978/1964] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:09.235713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:09.463417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79479375549841d8a46c14555cdc80f9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.464023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79479375549841d8a46c14555cdc80f9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.471129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79479375549841d8a46c14555cdc80f9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.550108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79479375549841d8a46c14555cdc80f9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.566871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79479375549841d8a46c14555cdc80f9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:09.576714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 987/1965] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:09 2022] DELETE /identity/v3/users/79479375549841d8a46c14555cdc80f9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:09.816497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ee558-bc7b-4aa5-9774-1028f25447d4 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:09.816878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ee558-bc7b-4aa5-9774-1028f25447d4 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:09.817231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ee558-bc7b-4aa5-9774-1028f25447d4 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:09.818702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 979/1966] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:41:09.827451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:09.828953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:09.849681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabad9-851b-4920-861e-961c27e3da25 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:09.849968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabad9-851b-4920-861e-961c27e3da25 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:09.850250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabad9-851b-4920-861e-961c27e3da25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:09.871694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-98cabad9-851b-4920-861e-961c27e3da25 None None] MFA Rules not processed for user `b2e57a7647d143f5835225616138827e`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:09.873467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-98cabad9-851b-4920-861e-961c27e3da25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:09.898853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcfba3-eb49-4669-ae31-01d4f998ce4c admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:09.905683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:09.906746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:09.907896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:09.910152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] PATH_INFO: `/v3/projects/99927aef2b994e8180bb1d1868177084` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:09.910152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99927aef2b994e8180bb1d1868177084)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:09.912599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:09.993765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 980/1967] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:41:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:09.994758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cabad9-851b-4920-861e-961c27e3da25 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:09.996303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-98cabad9-851b-4920-861e-961c27e3da25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:10.025847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cabad9-851b-4920-861e-961c27e3da25 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:10.031602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:10.033047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:10.033415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:10.033914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] PATH_INFO: `/v3/projects/273c864c7bf14725ae0cdb7503d05430` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:10.035501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273c864c7bf14725ae0cdb7503d05430)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:10.041819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:10.086602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99927aef2b994e8180bb1d1868177084', 'request_id': 'req-52bb0056-8b58-4863-8a5d-8bf6fc55a029'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.096525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99927aef2b994e8180bb1d1868177084', 'request_id': 'req-52bb0056-8b58-4863-8a5d-8bf6fc55a029'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.106869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99927aef2b994e8180bb1d1868177084', 'request_id': 'req-52bb0056-8b58-4863-8a5d-8bf6fc55a029'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.198563 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] The token cache is being invalidate because project 99927aef2b994e8180bb1d1868177084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:10.199184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.199816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.201586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 988/1968] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:09 2022] DELETE /identity/v3/projects/99927aef2b994e8180bb1d1868177084 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:10.202374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:10.203637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:10.213506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273c864c7bf14725ae0cdb7503d05430', 'request_id': 'req-95d0e99e-5a2a-4973-8ebb-921a763b6820'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.226669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273c864c7bf14725ae0cdb7503d05430', 'request_id': 'req-95d0e99e-5a2a-4973-8ebb-921a763b6820'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.294838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb0056-8b58-4863-8a5d-8bf6fc55a029 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:10.341722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273c864c7bf14725ae0cdb7503d05430', 'request_id': 'req-95d0e99e-5a2a-4973-8ebb-921a763b6820'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.353146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] The token cache is being invalidate because project 273c864c7bf14725ae0cdb7503d05430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:10.353501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.354066 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:10.354207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.358897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:10.358897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:10.358897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:10.359123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 981/1969] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:09 2022] DELETE /identity/v3/projects/273c864c7bf14725ae0cdb7503d05430 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:10.359123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:10.359123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:10.359790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:10.362006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:10.371007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:10.372715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:10.382882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 989/1970] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:10.383834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:10.385108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:10.431695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0e99e-5a2a-4973-8ebb-921a763b6820 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:10.436482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:10.437361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:10.437644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:10.437921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] PATH_INFO: `/v3/users/1616dff84f03410f9b8a1c1c3b853b90` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:10.439115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1616dff84f03410f9b8a1c1c3b853b90)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:10.441070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:10.451825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07651749-bd46-4101-92c1-31e85d3c9316 service placement] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:10.457991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:10.458861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:10.459149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:10.459427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] PATH_INFO: `/v3/users/fa438f0a46d84d498a2261093e31caa2` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:10.460687 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa438f0a46d84d498a2261093e31caa2)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:10.463138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:10.656924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1616dff84f03410f9b8a1c1c3b853b90'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.657581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1616dff84f03410f9b8a1c1c3b853b90'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.692598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa438f0a46d84d498a2261093e31caa2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.693245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa438f0a46d84d498a2261093e31caa2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.700578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa438f0a46d84d498a2261093e31caa2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.774324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1616dff84f03410f9b8a1c1c3b853b90'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.782352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1616dff84f03410f9b8a1c1c3b853b90'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.793743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1616dff84f03410f9b8a1c1c3b853b90'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.799674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 982/1971] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:10 2022] DELETE /identity/v3/users/1616dff84f03410f9b8a1c1c3b853b90 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:10.800643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:10.801953 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:10.862028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa438f0a46d84d498a2261093e31caa2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.868113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57221779-e29d-4230-adac-2687f893fe23 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:10.872219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:10.873099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:10.873385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:10.873665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] PATH_INFO: `/v3/projects/e1818cb49e1d463d90f501cb934938d0` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:10.874870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1818cb49e1d463d90f501cb934938d0)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:10.877139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:10.878439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa438f0a46d84d498a2261093e31caa2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:10.886136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 990/1972] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:10 2022] DELETE /identity/v3/users/fa438f0a46d84d498a2261093e31caa2 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:10.887355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:10.889549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:10.961507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cdaea-ccd3-4621-9310-1dfcf801115b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:10.967583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:10.968533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:10.969221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:10.969221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] PATH_INFO: `/v3/projects/5d1c8ba7cbfb46a3a11ffb1fc91fc4ba` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:10.970417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1c8ba7cbfb46a3a11ffb1fc91fc4ba)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:10.972451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:11.015463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1818cb49e1d463d90f501cb934938d0', 'request_id': 'req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.021699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1818cb49e1d463d90f501cb934938d0', 'request_id': 'req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.091898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1818cb49e1d463d90f501cb934938d0', 'request_id': 'req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.111177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] The token cache is being invalidate because project e1818cb49e1d463d90f501cb934938d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:11.111177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.112164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.115357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 983/1973] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:10 2022] DELETE /identity/v3/projects/e1818cb49e1d463d90f501cb934938d0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:11.116826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:11.119627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:11.135691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1c8ba7cbfb46a3a11ffb1fc91fc4ba', 'request_id': 'req-3b7b7b8e-15d3-4a76-a28a-28da88b34430'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.142374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1c8ba7cbfb46a3a11ffb1fc91fc4ba', 'request_id': 'req-3b7b7b8e-15d3-4a76-a28a-28da88b34430'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.150082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1c8ba7cbfb46a3a11ffb1fc91fc4ba', 'request_id': 'req-3b7b7b8e-15d3-4a76-a28a-28da88b34430'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.235692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b8dcb-ac2b-4878-91e4-7c29a3bc594b admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:11.240718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] The token cache is being invalidate because project 5d1c8ba7cbfb46a3a11ffb1fc91fc4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:11.241204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.242339 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.247668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 991/1974] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:10 2022] DELETE /identity/v3/projects/5d1c8ba7cbfb46a3a11ffb1fc91fc4ba => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:11.248079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:11.249534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:11.312379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:11.313265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:11.313549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:11.313826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] PATH_INFO: `/v3/users/16d25944b6944a469a0bed8c9399e67f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:11.314891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:11.315067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d25944b6944a469a0bed8c9399e67f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:11.322390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:11.333086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b7b8e-15d3-4a76-a28a-28da88b34430 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:11.337884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:11.338750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:11.339033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:11.339323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] PATH_INFO: `/v3/projects/2aa36ad3985147bea21fb375453ab8cf` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:11.340654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa36ad3985147bea21fb375453ab8cf)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:11.342584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:11.479441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:11.524653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d25944b6944a469a0bed8c9399e67f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.525369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d25944b6944a469a0bed8c9399e67f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.525668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa36ad3985147bea21fb375453ab8cf', 'request_id': 'req-8b453ff2-49cf-4436-98ae-85e03b0b8940'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.531460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa36ad3985147bea21fb375453ab8cf', 'request_id': 'req-8b453ff2-49cf-4436-98ae-85e03b0b8940'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.537783 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa36ad3985147bea21fb375453ab8cf', 'request_id': 'req-8b453ff2-49cf-4436-98ae-85e03b0b8940'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.633667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d25944b6944a469a0bed8c9399e67f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.641265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d25944b6944a469a0bed8c9399e67f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.653043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d25944b6944a469a0bed8c9399e67f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.658904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 984/1975] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:11 2022] DELETE /identity/v3/users/16d25944b6944a469a0bed8c9399e67f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:11.659685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:11.661170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:11.725668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8be927-1b7d-4f8a-ae9f-ac834f135083 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:11.730858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:11.731758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:11.732041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:11.732324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] PATH_INFO: `/v3/users/185edee65dae4de6a8bb0df8d3639659` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:11.733536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=185edee65dae4de6a8bb0df8d3639659)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:11.735463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:11.752411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] The token cache is being invalidate because project 2aa36ad3985147bea21fb375453ab8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:11.752734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.753475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8b453ff2-49cf-4436-98ae-85e03b0b8940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:11.755093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 992/1976] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:11 2022] DELETE /identity/v3/projects/2aa36ad3985147bea21fb375453ab8cf => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:11.756590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43000e4d-a366-4fa7-916d-5ea8de71691a None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:11.757133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43000e4d-a366-4fa7-916d-5ea8de71691a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:11.757321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43000e4d-a366-4fa7-916d-5ea8de71691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:11.776276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-43000e4d-a366-4fa7-916d-5ea8de71691a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:11.777468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-43000e4d-a366-4fa7-916d-5ea8de71691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:11.785408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 993/1977] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:11.786058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43000e4d-a366-4fa7-916d-5ea8de71691a None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:11.787399 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-43000e4d-a366-4fa7-916d-5ea8de71691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:11.799726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43000e4d-a366-4fa7-916d-5ea8de71691a None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:11.804397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:11.805230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:11.805514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:11.805791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] PATH_INFO: `/v3/projects/fc2e6ce9193f4ae687497aa30da600ec` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:11.806986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2e6ce9193f4ae687497aa30da600ec)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:11.808969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.002854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2e6ce9193f4ae687497aa30da600ec', 'request_id': 'req-9ec554ad-a7e4-444e-aea8-0e097115408f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.004864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185edee65dae4de6a8bb0df8d3639659'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.005563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185edee65dae4de6a8bb0df8d3639659'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.008483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2e6ce9193f4ae687497aa30da600ec', 'request_id': 'req-9ec554ad-a7e4-444e-aea8-0e097115408f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.015180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2e6ce9193f4ae687497aa30da600ec', 'request_id': 'req-9ec554ad-a7e4-444e-aea8-0e097115408f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.093675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185edee65dae4de6a8bb0df8d3639659'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.105707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185edee65dae4de6a8bb0df8d3639659'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.119160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6c6a8d96-b763-4349-b543-824c2ea735f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185edee65dae4de6a8bb0df8d3639659'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.125800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 985/1978] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:11 2022] DELETE /identity/v3/users/185edee65dae4de6a8bb0df8d3639659 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:12.127066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b1c4-2b15-436c-af35-442c0b118c8a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.127674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b1c4-2b15-436c-af35-442c0b118c8a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.127853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b1c4-2b15-436c-af35-442c0b118c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.150206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f5a0b1c4-2b15-436c-af35-442c0b118c8a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:12.151983 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f5a0b1c4-2b15-436c-af35-442c0b118c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.188604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] The token cache is being invalidate because project fc2e6ce9193f4ae687497aa30da600ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:12.188861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.189729 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ec554ad-a7e4-444e-aea8-0e097115408f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.192105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 994/1979] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:11 2022] DELETE /identity/v3/projects/fc2e6ce9193f4ae687497aa30da600ec => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:12.195392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b39b0c-8966-4e36-b595-770f81ca01ad None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.195392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b39b0c-8966-4e36-b595-770f81ca01ad None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.195392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b39b0c-8966-4e36-b595-770f81ca01ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.215361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d4b39b0c-8966-4e36-b595-770f81ca01ad None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:12.216690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d4b39b0c-8966-4e36-b595-770f81ca01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.219505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 986/1980] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:12.220747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b1c4-2b15-436c-af35-442c0b118c8a None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:12.222115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f5a0b1c4-2b15-436c-af35-442c0b118c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.226058 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 995/1981] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:12.227385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439e6e3-9f95-4447-977b-a7b65284f558 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.227675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439e6e3-9f95-4447-977b-a7b65284f558 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.227981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439e6e3-9f95-4447-977b-a7b65284f558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.234710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b1c4-2b15-436c-af35-442c0b118c8a None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:12.240427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:12.241435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.241685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.241961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] PATH_INFO: `/v3/projects/d13e2e14c65f491ba02f35a5df3b27dd` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.243168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13e2e14c65f491ba02f35a5df3b27dd)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:12.245932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.247821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-8439e6e3-9f95-4447-977b-a7b65284f558 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:12.249048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8439e6e3-9f95-4447-977b-a7b65284f558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.256966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 996/1982] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:12.264122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0dfb-3c95-4b0c-a107-e2de4bba0ff4 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.264122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0dfb-3c95-4b0c-a107-e2de4bba0ff4 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.264122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0dfb-3c95-4b0c-a107-e2de4bba0ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.278370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a00f0dfb-3c95-4b0c-a107-e2de4bba0ff4 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:12.279549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a00f0dfb-3c95-4b0c-a107-e2de4bba0ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.287503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 997/1983] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:12.288431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0dfb-3c95-4b0c-a107-e2de4bba0ff4 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:12.298060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0dfb-3c95-4b0c-a107-e2de4bba0ff4 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:12.302589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd825e-d427-47c0-982f-8cc5972aceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:12.303210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd825e-d427-47c0-982f-8cc5972aceb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.303492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd825e-d427-47c0-982f-8cc5972aceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.303789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd825e-d427-47c0-982f-8cc5972aceb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.304491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd825e-d427-47c0-982f-8cc5972aceb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:12.304797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd825e-d427-47c0-982f-8cc5972aceb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:12.306432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd825e-d427-47c0-982f-8cc5972aceb3 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.318361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 998/1984] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:12.319583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c4fcf-2b66-4346-9961-079557acb835 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.322757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c4fcf-2b66-4346-9961-079557acb835 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.322757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c4fcf-2b66-4346-9961-079557acb835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.339871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-fe5c4fcf-2b66-4346-9961-079557acb835 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:12.341897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fe5c4fcf-2b66-4346-9961-079557acb835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.354100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 999/1985] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:12.354100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c4fcf-2b66-4346-9961-079557acb835 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:12.361996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c4fcf-2b66-4346-9961-079557acb835 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:12.401977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13e2e14c65f491ba02f35a5df3b27dd', 'request_id': 'req-e82bf89d-7eb1-4240-9054-04a9528514af'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.409915 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13e2e14c65f491ba02f35a5df3b27dd', 'request_id': 'req-e82bf89d-7eb1-4240-9054-04a9528514af'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.430363 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72d709-cee1-4049-9c50-be3d28dc2a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:12.431055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72d709-cee1-4049-9c50-be3d28dc2a7a admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.431382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72d709-cee1-4049-9c50-be3d28dc2a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.432500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72d709-cee1-4049-9c50-be3d28dc2a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.433708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72d709-cee1-4049-9c50-be3d28dc2a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:12.434181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72d709-cee1-4049-9c50-be3d28dc2a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:12.436433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72d709-cee1-4049-9c50-be3d28dc2a7a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.451573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1000/1986] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:12.452454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72d709-cee1-4049-9c50-be3d28dc2a7a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:12.465034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72d709-cee1-4049-9c50-be3d28dc2a7a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:12.472219 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d25350-44a4-49b9-8c26-f0a3e44be67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:12.473436 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d25350-44a4-49b9-8c26-f0a3e44be67c admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.473436 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d25350-44a4-49b9-8c26-f0a3e44be67c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.473613 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d25350-44a4-49b9-8c26-f0a3e44be67c admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.474237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d25350-44a4-49b9-8c26-f0a3e44be67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:12.476496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d25350-44a4-49b9-8c26-f0a3e44be67c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.482905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13e2e14c65f491ba02f35a5df3b27dd', 'request_id': 'req-e82bf89d-7eb1-4240-9054-04a9528514af'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.497663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] The token cache is being invalidate because project d13e2e14c65f491ba02f35a5df3b27dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:12.497940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.498668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.503349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 987/1987] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:12 2022] DELETE /identity/v3/projects/d13e2e14c65f491ba02f35a5df3b27dd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:12.503349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:12.503349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.516500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bf89d-7eb1-4240-9054-04a9528514af admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:12.521150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:12.521804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.522087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.522366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.523157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:12.523473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:12.525125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.537143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 988/1988] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:12.537895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:12.539590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.551978 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1d681-5b5a-4f94-88c4-366047d459ea admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:12.557245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ec54a-dc25-4ed2-aa18-4f79da8b4642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:12.557863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ec54a-dc25-4ed2-aa18-4f79da8b4642 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.558149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ec54a-dc25-4ed2-aa18-4f79da8b4642 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.558430 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ec54a-dc25-4ed2-aa18-4f79da8b4642 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.559103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ec54a-dc25-4ed2-aa18-4f79da8b4642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:12.561006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ec54a-dc25-4ed2-aa18-4f79da8b4642 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.583571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1001/1989] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:12 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:12.584570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d25350-44a4-49b9-8c26-f0a3e44be67c admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:12.586379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c3d25350-44a4-49b9-8c26-f0a3e44be67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.651332 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d25350-44a4-49b9-8c26-f0a3e44be67c admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:12.656170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:12.657051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.657339 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.657487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 989/1990] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:12 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:12.658234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ec54a-dc25-4ed2-aa18-4f79da8b4642 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:12.660045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] PATH_INFO: `/v3/users/c18643dc21184959a3530d24b0b674e1` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.661383 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18643dc21184959a3530d24b0b674e1)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:12.663335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.719603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ec54a-dc25-4ed2-aa18-4f79da8b4642 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:12.724256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb63396-70c9-4f17-8eb3-71d29eb714d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:12.724912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb63396-70c9-4f17-8eb3-71d29eb714d1 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.725196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb63396-70c9-4f17-8eb3-71d29eb714d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.725504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb63396-70c9-4f17-8eb3-71d29eb714d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.726187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb63396-70c9-4f17-8eb3-71d29eb714d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:12.728131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb63396-70c9-4f17-8eb3-71d29eb714d1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.857854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 990/1991] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:12 2022] POST /identity/v3/projects => generated 391 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:12.858777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb63396-70c9-4f17-8eb3-71d29eb714d1 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:12.860404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-cfb63396-70c9-4f17-8eb3-71d29eb714d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:12.922473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb63396-70c9-4f17-8eb3-71d29eb714d1 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:12.927182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:12.928060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:12.928351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:12.928634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] PATH_INFO: `/v3/projects/e84d2668f10c41e88ca78bbd5ffe11ae` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:12.929819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84d2668f10c41e88ca78bbd5ffe11ae)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:12.932403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:12.948874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18643dc21184959a3530d24b0b674e1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.949542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18643dc21184959a3530d24b0b674e1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:12.956362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18643dc21184959a3530d24b0b674e1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.010923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:13.045174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18643dc21184959a3530d24b0b674e1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.058411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18643dc21184959a3530d24b0b674e1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.063288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84d2668f10c41e88ca78bbd5ffe11ae', 'request_id': 'req-d150c87e-a51e-4524-901c-ca7c1b9a31e4'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.064387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1002/1992] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:12 2022] DELETE /identity/v3/users/c18643dc21184959a3530d24b0b674e1 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:13.065149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.066536 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:13.070226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84d2668f10c41e88ca78bbd5ffe11ae', 'request_id': 'req-d150c87e-a51e-4524-901c-ca7c1b9a31e4'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.130401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b5f80-8c77-421e-bc2b-0009b32de74e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.135095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849839-e082-4d16-9cbb-c3c48cbeb0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.135788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849839-e082-4d16-9cbb-c3c48cbeb0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.136739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849839-e082-4d16-9cbb-c3c48cbeb0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.136739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849839-e082-4d16-9cbb-c3c48cbeb0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.136912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84d2668f10c41e88ca78bbd5ffe11ae', 'request_id': 'req-d150c87e-a51e-4524-901c-ca7c1b9a31e4'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.137356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3849839-e082-4d16-9cbb-c3c48cbeb0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.139425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3849839-e082-4d16-9cbb-c3c48cbeb0d0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.148819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] The token cache is being invalidate because project e84d2668f10c41e88ca78bbd5ffe11ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:13.149106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.149995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.151725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 991/1993] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:12 2022] DELETE /identity/v3/projects/e84d2668f10c41e88ca78bbd5ffe11ae => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:13.152936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.153873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:13.165049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:13.217782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c87e-a51e-4524-901c-ca7c1b9a31e4 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.222434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985af28-bade-4d86-8f1a-925e78342461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.223098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985af28-bade-4d86-8f1a-925e78342461 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.223384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985af28-bade-4d86-8f1a-925e78342461 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.223665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985af28-bade-4d86-8f1a-925e78342461 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.224384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985af28-bade-4d86-8f1a-925e78342461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.226337 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985af28-bade-4d86-8f1a-925e78342461 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.231460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1003/1994] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:13 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:13.231460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849839-e082-4d16-9cbb-c3c48cbeb0d0 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.231460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a3849839-e082-4d16-9cbb-c3c48cbeb0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:13.242489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849839-e082-4d16-9cbb-c3c48cbeb0d0 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.247701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ac26-8982-44ce-b453-5a7d2a15cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.248366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ac26-8982-44ce-b453-5a7d2a15cbdf admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.248900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ac26-8982-44ce-b453-5a7d2a15cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.249560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ac26-8982-44ce-b453-5a7d2a15cbdf admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.250341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357ac26-8982-44ce-b453-5a7d2a15cbdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.252325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357ac26-8982-44ce-b453-5a7d2a15cbdf admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.313209 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 992/1995] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:13 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:13.316928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777595af-58cd-4799-9485-c3c37aca7117 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.316928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777595af-58cd-4799-9485-c3c37aca7117 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.316928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777595af-58cd-4799-9485-c3c37aca7117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.334774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-777595af-58cd-4799-9485-c3c37aca7117 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:13.336087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-777595af-58cd-4799-9485-c3c37aca7117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:13.343117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1004/1996] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:13 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:13.344110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ac26-8982-44ce-b453-5a7d2a15cbdf admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.352532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 993/1997] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:13.352532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777595af-58cd-4799-9485-c3c37aca7117 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.355143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0357ac26-8982-44ce-b453-5a7d2a15cbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:13.358437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777595af-58cd-4799-9485-c3c37aca7117 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.363362 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5f96c-f536-404e-89e6-35526d0e676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.364114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5f96c-f536-404e-89e6-35526d0e676c admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.364493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5f96c-f536-404e-89e6-35526d0e676c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.364874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5f96c-f536-404e-89e6-35526d0e676c admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.365694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5f96c-f536-404e-89e6-35526d0e676c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.367397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5f96c-f536-404e-89e6-35526d0e676c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.373497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ac26-8982-44ce-b453-5a7d2a15cbdf admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.375239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74935830-98e1-4ec7-9c16-ac1353bb3db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.375950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935830-98e1-4ec7-9c16-ac1353bb3db7 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.376235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935830-98e1-4ec7-9c16-ac1353bb3db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.376514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935830-98e1-4ec7-9c16-ac1353bb3db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.377231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74935830-98e1-4ec7-9c16-ac1353bb3db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.381397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 994/1998] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:13.381570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74935830-98e1-4ec7-9c16-ac1353bb3db7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.381680 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5f96c-f536-404e-89e6-35526d0e676c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.390694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1005/1999] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:13.391844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2521c9-ccf4-4e04-8166-f5806baa7a80 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.392137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2521c9-ccf4-4e04-8166-f5806baa7a80 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.392413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2521c9-ccf4-4e04-8166-f5806baa7a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.394590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5f96c-f536-404e-89e6-35526d0e676c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.401591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ce055-4ed7-4cbe-bc68-553e1fab685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.403184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce055-4ed7-4cbe-bc68-553e1fab685e admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.403184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce055-4ed7-4cbe-bc68-553e1fab685e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.403351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce055-4ed7-4cbe-bc68-553e1fab685e admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.404147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ce055-4ed7-4cbe-bc68-553e1fab685e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.405872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ce055-4ed7-4cbe-bc68-553e1fab685e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.412874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-0f2521c9-ccf4-4e04-8166-f5806baa7a80 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:13.414080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0f2521c9-ccf4-4e04-8166-f5806baa7a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:13.420024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 995/2000] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:13.420024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ce055-4ed7-4cbe-bc68-553e1fab685e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.425837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1006/2001] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:13.428609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2521c9-ccf4-4e04-8166-f5806baa7a80 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.428734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ce055-4ed7-4cbe-bc68-553e1fab685e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.433948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba0136-ef48-4bd0-92c3-bad85fb311aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.434607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba0136-ef48-4bd0-92c3-bad85fb311aa admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.434898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba0136-ef48-4bd0-92c3-bad85fb311aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.435181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba0136-ef48-4bd0-92c3-bad85fb311aa admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.435940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba0136-ef48-4bd0-92c3-bad85fb311aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.437536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba0136-ef48-4bd0-92c3-bad85fb311aa admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.438559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2521c9-ccf4-4e04-8166-f5806baa7a80 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.443888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d2656-b900-4037-a47c-7368647bd198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.444534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d2656-b900-4037-a47c-7368647bd198 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.444813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d2656-b900-4037-a47c-7368647bd198 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.445083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d2656-b900-4037-a47c-7368647bd198 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.445819 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d2656-b900-4037-a47c-7368647bd198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.448122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d2656-b900-4037-a47c-7368647bd198 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.452244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 996/2002] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:13.452244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba0136-ef48-4bd0-92c3-bad85fb311aa admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.459329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1007/2003] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:13.459329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d2656-b900-4037-a47c-7368647bd198 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.461783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba0136-ef48-4bd0-92c3-bad85fb311aa admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.466874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215357d0-f81b-456b-b8b1-258d9942a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.467653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215357d0-f81b-456b-b8b1-258d9942a826 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.467968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215357d0-f81b-456b-b8b1-258d9942a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.468245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215357d0-f81b-456b-b8b1-258d9942a826 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.468619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d2656-b900-4037-a47c-7368647bd198 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.468957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215357d0-f81b-456b-b8b1-258d9942a826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.470536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215357d0-f81b-456b-b8b1-258d9942a826 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.473118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9b02b-6711-4a0d-8063-8934e1e684eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.473749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9b02b-6711-4a0d-8063-8934e1e684eb admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.474030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9b02b-6711-4a0d-8063-8934e1e684eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.474305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9b02b-6711-4a0d-8063-8934e1e684eb admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.475007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9b02b-6711-4a0d-8063-8934e1e684eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:13.475309 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9b02b-6711-4a0d-8063-8934e1e684eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.476901 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9b02b-6711-4a0d-8063-8934e1e684eb admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.480947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 997/2004] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:13.481744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215357d0-f81b-456b-b8b1-258d9942a826 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.496047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1008/2005] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:13.496047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9b02b-6711-4a0d-8063-8934e1e684eb admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.499230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215357d0-f81b-456b-b8b1-258d9942a826 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.504843 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51492-e552-477f-b759-064becf14b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.505308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51492-e552-477f-b759-064becf14b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.505587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51492-e552-477f-b759-064becf14b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.506497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51492-e552-477f-b759-064becf14b7e admin admin] PATH_INFO: `/v3/projects/aaa1c6b8f80d4df3a0b4b321bba9d790/users/457895b726f04319a34aa0a5e3e8289b/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.509427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9b02b-6711-4a0d-8063-8934e1e684eb admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.523494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134548e-d595-4e6d-bec4-81fc8d8f93b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.524486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f51492-e552-477f-b759-064becf14b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa1c6b8f80d4df3a0b4b321bba9d790, user_id=457895b726f04319a34aa0a5e3e8289b, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.524624 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134548e-d595-4e6d-bec4-81fc8d8f93b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.524814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134548e-d595-4e6d-bec4-81fc8d8f93b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.525094 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134548e-d595-4e6d-bec4-81fc8d8f93b0 admin admin] PATH_INFO: `/v3/projects/51cc8fb70b8245918868eb71ba7b2845/users/d05983b7dd5c4018a7c2dbfcfadbd5cb/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.528390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f51492-e552-477f-b759-064becf14b7e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.546784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134548e-d595-4e6d-bec4-81fc8d8f93b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51cc8fb70b8245918868eb71ba7b2845, user_id=d05983b7dd5c4018a7c2dbfcfadbd5cb, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.546784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134548e-d595-4e6d-bec4-81fc8d8f93b0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.622440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 998/2006] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:13 2022] PUT /identity/v3/projects/aaa1c6b8f80d4df3a0b4b321bba9d790/users/457895b726f04319a34aa0a5e3e8289b/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:13.625855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51492-e552-477f-b759-064becf14b7e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.625855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-41f51492-e552-477f-b759-064becf14b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:13.652208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1009/2007] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:13 2022] PUT /identity/v3/projects/51cc8fb70b8245918868eb71ba7b2845/users/d05983b7dd5c4018a7c2dbfcfadbd5cb/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:13.652208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134548e-d595-4e6d-bec4-81fc8d8f93b0 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.693628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51492-e552-477f-b759-064becf14b7e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.716856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134548e-d595-4e6d-bec4-81fc8d8f93b0 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.721534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dd285-b8b9-485e-89de-40918f4b96ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.722415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dd285-b8b9-485e-89de-40918f4b96ad admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.722709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dd285-b8b9-485e-89de-40918f4b96ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.722973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dd285-b8b9-485e-89de-40918f4b96ad admin admin] PATH_INFO: `/v3/projects/7786e5a3967f48bf85de58f3b83c8efb/users/dc2e8080cd194e8ab00e16d3f2cf55f2/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.738260 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dd285-b8b9-485e-89de-40918f4b96ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7786e5a3967f48bf85de58f3b83c8efb, user_id=dc2e8080cd194e8ab00e16d3f2cf55f2, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.740988 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dd285-b8b9-485e-89de-40918f4b96ad admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.749980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.750848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.751137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.751421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] PATH_INFO: `/v3/projects/7ca8ab460cca48fa986ff2b1c881538d` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.752665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca8ab460cca48fa986ff2b1c881538d)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.757085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.811153 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1010/2008] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:13 2022] PUT /identity/v3/projects/7786e5a3967f48bf85de58f3b83c8efb/users/dc2e8080cd194e8ab00e16d3f2cf55f2/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:13.812329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dd285-b8b9-485e-89de-40918f4b96ad admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:13.872017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dd285-b8b9-485e-89de-40918f4b96ad admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:13.876658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85813d39-1cc0-42ec-a08f-064e5ba7fd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:13.877307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85813d39-1cc0-42ec-a08f-064e5ba7fd27 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.877590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85813d39-1cc0-42ec-a08f-064e5ba7fd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.877868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85813d39-1cc0-42ec-a08f-064e5ba7fd27 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:13.878542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85813d39-1cc0-42ec-a08f-064e5ba7fd27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:13.880479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85813d39-1cc0-42ec-a08f-064e5ba7fd27 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:13.902989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca8ab460cca48fa986ff2b1c881538d', 'request_id': 'req-109db6e2-6dae-413b-96ef-02132efddb50'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.909385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca8ab460cca48fa986ff2b1c881538d', 'request_id': 'req-109db6e2-6dae-413b-96ef-02132efddb50'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:13.994258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1011/2009] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:13 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:13.996344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd565b6-956c-4776-9236-f80bbae55dc1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:13.996630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd565b6-956c-4776-9236-f80bbae55dc1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:13.996913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd565b6-956c-4776-9236-f80bbae55dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.015806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca8ab460cca48fa986ff2b1c881538d', 'request_id': 'req-109db6e2-6dae-413b-96ef-02132efddb50'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:14.024112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7cd565b6-956c-4776-9236-f80bbae55dc1 None None] MFA Rules not processed for user `457895b726f04319a34aa0a5e3e8289b`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:14.025915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7cd565b6-956c-4776-9236-f80bbae55dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:14.028786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] The token cache is being invalidate because project 7ca8ab460cca48fa986ff2b1c881538d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:14.029086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:14.029756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-109db6e2-6dae-413b-96ef-02132efddb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:14.034794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 999/2010] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:13 2022] DELETE /identity/v3/projects/7ca8ab460cca48fa986ff2b1c881538d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:14.036179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193986a-6ebe-48d4-afd5-d94859dd2f91 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.036468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193986a-6ebe-48d4-afd5-d94859dd2f91 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.036750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193986a-6ebe-48d4-afd5-d94859dd2f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.055018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4193986a-6ebe-48d4-afd5-d94859dd2f91 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:14.056263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4193986a-6ebe-48d4-afd5-d94859dd2f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:14.090717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1012/2011] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:14.092034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462989-efe4-4a97-b8a8-8fb48017e6ba None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.092321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462989-efe4-4a97-b8a8-8fb48017e6ba None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.092593 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a462989-efe4-4a97-b8a8-8fb48017e6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.116239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1000/2012] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:14.117065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193986a-6ebe-48d4-afd5-d94859dd2f91 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.120164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7a462989-efe4-4a97-b8a8-8fb48017e6ba None None] MFA Rules not processed for user `dc2e8080cd194e8ab00e16d3f2cf55f2`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:14.120406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4193986a-6ebe-48d4-afd5-d94859dd2f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:14.121374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7a462989-efe4-4a97-b8a8-8fb48017e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:14.132212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193986a-6ebe-48d4-afd5-d94859dd2f91 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.137228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe6b7d-51e1-41ac-a8f0-ac9838163d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.137893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe6b7d-51e1-41ac-a8f0-ac9838163d3e admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.138184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe6b7d-51e1-41ac-a8f0-ac9838163d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.138463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe6b7d-51e1-41ac-a8f0-ac9838163d3e admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.139176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe6b7d-51e1-41ac-a8f0-ac9838163d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.141174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe6b7d-51e1-41ac-a8f0-ac9838163d3e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.185001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1013/2013] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:14.186425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1969-f817-49b9-a039-d7a2fd871cb9 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.186724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1969-f817-49b9-a039-d7a2fd871cb9 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.187010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1969-f817-49b9-a039-d7a2fd871cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.204047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7ccb1969-f817-49b9-a039-d7a2fd871cb9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:14.205240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7ccb1969-f817-49b9-a039-d7a2fd871cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:14.213628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1014/2014] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:14.214539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1969-f817-49b9-a039-d7a2fd871cb9 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.215992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7ccb1969-f817-49b9-a039-d7a2fd871cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:14.227225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1969-f817-49b9-a039-d7a2fd871cb9 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.232574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237da33f-36bc-47e9-9966-f8cca8e64fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.233225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237da33f-36bc-47e9-9966-f8cca8e64fab admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.233511 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237da33f-36bc-47e9-9966-f8cca8e64fab admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.233790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237da33f-36bc-47e9-9966-f8cca8e64fab admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.234456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237da33f-36bc-47e9-9966-f8cca8e64fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.237581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237da33f-36bc-47e9-9966-f8cca8e64fab admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.261892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1001/2015] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:14.262722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe6b7d-51e1-41ac-a8f0-ac9838163d3e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.264311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-17fe6b7d-51e1-41ac-a8f0-ac9838163d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:14.267657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:14.317826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe6b7d-51e1-41ac-a8f0-ac9838163d3e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.321423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af414ec-1121-4c2c-9e8a-e58ebbe1b565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.322404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af414ec-1121-4c2c-9e8a-e58ebbe1b565 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.322691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af414ec-1121-4c2c-9e8a-e58ebbe1b565 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.322975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af414ec-1121-4c2c-9e8a-e58ebbe1b565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.332205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af414ec-1121-4c2c-9e8a-e58ebbe1b565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.333633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af414ec-1121-4c2c-9e8a-e58ebbe1b565 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.343327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1002/2016] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:14.344121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af414ec-1121-4c2c-9e8a-e58ebbe1b565 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.345389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-2af414ec-1121-4c2c-9e8a-e58ebbe1b565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:14.358057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af414ec-1121-4c2c-9e8a-e58ebbe1b565 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.362826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b07a3-dc9c-47ea-9624-adf3a3d33ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.363481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b07a3-dc9c-47ea-9624-adf3a3d33ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.363790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b07a3-dc9c-47ea-9624-adf3a3d33ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.364076 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b07a3-dc9c-47ea-9624-adf3a3d33ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.364758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b07a3-dc9c-47ea-9624-adf3a3d33ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.366654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b07a3-dc9c-47ea-9624-adf3a3d33ab1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.369807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1015/2017] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:14.369807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5757d-807e-40d0-9156-cbbd396beef8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.369807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5757d-807e-40d0-9156-cbbd396beef8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.369807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5757d-807e-40d0-9156-cbbd396beef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.388465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-80d5757d-807e-40d0-9156-cbbd396beef8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:14.389647 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-80d5757d-807e-40d0-9156-cbbd396beef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:14.445576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1016/2018] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:14.446407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5757d-807e-40d0-9156-cbbd396beef8 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.456295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5757d-807e-40d0-9156-cbbd396beef8 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.461103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84d3b0-3349-4b94-92b5-8f2044821eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.461759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84d3b0-3349-4b94-92b5-8f2044821eab admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.462041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84d3b0-3349-4b94-92b5-8f2044821eab admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.462316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84d3b0-3349-4b94-92b5-8f2044821eab admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.463621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84d3b0-3349-4b94-92b5-8f2044821eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.465262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84d3b0-3349-4b94-92b5-8f2044821eab admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.473937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1003/2019] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:14.473937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b07a3-dc9c-47ea-9624-adf3a3d33ab1 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.478723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1017/2020] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:14.478723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84d3b0-3349-4b94-92b5-8f2044821eab admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.488592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84d3b0-3349-4b94-92b5-8f2044821eab admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.549588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9814-5f64-49dc-a820-2111c32fe4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.550408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9814-5f64-49dc-a820-2111c32fe4ad admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.550742 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9814-5f64-49dc-a820-2111c32fe4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.550909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b07a3-dc9c-47ea-9624-adf3a3d33ab1 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.551067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9814-5f64-49dc-a820-2111c32fe4ad admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.551818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9814-5f64-49dc-a820-2111c32fe4ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:14.555270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9814-5f64-49dc-a820-2111c32fe4ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.555270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9814-5f64-49dc-a820-2111c32fe4ad admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.555790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fddc3-0ce9-4b63-8d1d-cdd86dde1919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.556488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fddc3-0ce9-4b63-8d1d-cdd86dde1919 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.556775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fddc3-0ce9-4b63-8d1d-cdd86dde1919 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.557055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fddc3-0ce9-4b63-8d1d-cdd86dde1919 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.557826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fddc3-0ce9-4b63-8d1d-cdd86dde1919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.559753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fddc3-0ce9-4b63-8d1d-cdd86dde1919 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.566495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1018/2021] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:14.567115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9814-5f64-49dc-a820-2111c32fe4ad admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.577006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9814-5f64-49dc-a820-2111c32fe4ad admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.581636 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552485-0184-47cd-a018-8771d9f5d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.582277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552485-0184-47cd-a018-8771d9f5d204 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.582561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552485-0184-47cd-a018-8771d9f5d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.582837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552485-0184-47cd-a018-8771d9f5d204 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.583503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552485-0184-47cd-a018-8771d9f5d204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.586073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552485-0184-47cd-a018-8771d9f5d204 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.643010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1004/2022] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:14.643010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fddc3-0ce9-4b63-8d1d-cdd86dde1919 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.651486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fddc3-0ce9-4b63-8d1d-cdd86dde1919 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.657114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a02a5b-3977-4893-9548-b23f25ba403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.657840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a02a5b-3977-4893-9548-b23f25ba403f admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.658128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a02a5b-3977-4893-9548-b23f25ba403f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.658404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a02a5b-3977-4893-9548-b23f25ba403f admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.659353 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a02a5b-3977-4893-9548-b23f25ba403f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.660757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a02a5b-3977-4893-9548-b23f25ba403f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.670984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1005/2023] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:14.671949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a02a5b-3977-4893-9548-b23f25ba403f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.685166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a02a5b-3977-4893-9548-b23f25ba403f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.689834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af56b8-c676-40a3-a5a5-fb99b8d406f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.690486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af56b8-c676-40a3-a5a5-fb99b8d406f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.690767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af56b8-c676-40a3-a5a5-fb99b8d406f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.691045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af56b8-c676-40a3-a5a5-fb99b8d406f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.691725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af56b8-c676-40a3-a5a5-fb99b8d406f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.703226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af56b8-c676-40a3-a5a5-fb99b8d406f0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.705863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1019/2024] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/users => generated 302 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:14.707160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552485-0184-47cd-a018-8771d9f5d204 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.719601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552485-0184-47cd-a018-8771d9f5d204 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.724646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9295b3-3205-434e-9d58-8fa21363d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.725421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9295b3-3205-434e-9d58-8fa21363d14f admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.725715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9295b3-3205-434e-9d58-8fa21363d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.726141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9295b3-3205-434e-9d58-8fa21363d14f admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.726874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9295b3-3205-434e-9d58-8fa21363d14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.728616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9295b3-3205-434e-9d58-8fa21363d14f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.738821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1020/2025] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:14.739615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9295b3-3205-434e-9d58-8fa21363d14f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.749269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9295b3-3205-434e-9d58-8fa21363d14f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.754151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b566-3341-47e2-a95a-9f43b5639a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.755053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b566-3341-47e2-a95a-9f43b5639a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.755314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b566-3341-47e2-a95a-9f43b5639a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.755590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b566-3341-47e2-a95a-9f43b5639a46 admin admin] PATH_INFO: `/v3/projects/1a369ad136184bc194d49eeef61e2b63/users/afdf2431fde34abeb482d07c726ad62a/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:14.771244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8b566-3341-47e2-a95a-9f43b5639a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a369ad136184bc194d49eeef61e2b63, user_id=afdf2431fde34abeb482d07c726ad62a, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:14.773963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8b566-3341-47e2-a95a-9f43b5639a46 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:14.851231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1006/2026] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:14 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:14.852679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af56b8-c676-40a3-a5a5-fb99b8d406f0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.901448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1021/2027] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:14 2022] PUT /identity/v3/projects/1a369ad136184bc194d49eeef61e2b63/users/afdf2431fde34abeb482d07c726ad62a/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:14.902618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b566-3341-47e2-a95a-9f43b5639a46 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:14.935590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af56b8-c676-40a3-a5a5-fb99b8d406f0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.983607 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b566-3341-47e2-a95a-9f43b5639a46 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:14.988296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100f0e-c886-4fa7-9c59-1614b56feada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:14.989177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100f0e-c886-4fa7-9c59-1614b56feada admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:14.989463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100f0e-c886-4fa7-9c59-1614b56feada admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:14.989744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100f0e-c886-4fa7-9c59-1614b56feada admin admin] PATH_INFO: `/v3/projects/fbce6b42da624e65930ed3df733b4ce2/users/afc46c62718147f6b09b9188907a9c7e/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.001765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84c64-7edf-4ee2-ab2a-9f691d5fe2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.002435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84c64-7edf-4ee2-ab2a-9f691d5fe2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.002715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84c64-7edf-4ee2-ab2a-9f691d5fe2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.002990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84c64-7edf-4ee2-ab2a-9f691d5fe2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.003704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb84c64-7edf-4ee2-ab2a-9f691d5fe2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.004722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100f0e-c886-4fa7-9c59-1614b56feada admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbce6b42da624e65930ed3df733b4ce2, user_id=afc46c62718147f6b09b9188907a9c7e, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.005317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb84c64-7edf-4ee2-ab2a-9f691d5fe2c7 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.007421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100f0e-c886-4fa7-9c59-1614b56feada admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.015857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1007/2028] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:15.025119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84c64-7edf-4ee2-ab2a-9f691d5fe2c7 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.026817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84c64-7edf-4ee2-ab2a-9f691d5fe2c7 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.031578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d029da-5f88-49d3-9bec-005ddca31825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.032259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d029da-5f88-49d3-9bec-005ddca31825 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.032541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d029da-5f88-49d3-9bec-005ddca31825 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.032814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d029da-5f88-49d3-9bec-005ddca31825 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.033485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d029da-5f88-49d3-9bec-005ddca31825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.035389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d029da-5f88-49d3-9bec-005ddca31825 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.091309 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1022/2029] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:14 2022] PUT /identity/v3/projects/fbce6b42da624e65930ed3df733b4ce2/users/afc46c62718147f6b09b9188907a9c7e/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:15.093093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e35aa-e954-4aba-9ec4-c146fd6d8757 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.093540 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e35aa-e954-4aba-9ec4-c146fd6d8757 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.093965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e35aa-e954-4aba-9ec4-c146fd6d8757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.121589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4f6e35aa-e954-4aba-9ec4-c146fd6d8757 None None] MFA Rules not processed for user `afdf2431fde34abeb482d07c726ad62a`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:15.122741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4f6e35aa-e954-4aba-9ec4-c146fd6d8757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:15.147363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1008/2030] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:15 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:15.149751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d029da-5f88-49d3-9bec-005ddca31825 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.159820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d029da-5f88-49d3-9bec-005ddca31825 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.198573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1023/2031] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:15.199495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e35aa-e954-4aba-9ec4-c146fd6d8757 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.228421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ca715-f211-44db-9996-f8fcc925fad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.229513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca715-f211-44db-9996-f8fcc925fad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.229783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca715-f211-44db-9996-f8fcc925fad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.230061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca715-f211-44db-9996-f8fcc925fad4 admin admin] PATH_INFO: `/v3/projects/82c346a3f6214b6bbecd808e8b8965d3/users/26789e1c35ef4fbca36cb34da64406ff/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.244495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ca715-f211-44db-9996-f8fcc925fad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c346a3f6214b6bbecd808e8b8965d3, user_id=26789e1c35ef4fbca36cb34da64406ff, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.247200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ca715-f211-44db-9996-f8fcc925fad4 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.251432 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:15.260724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e35aa-e954-4aba-9ec4-c146fd6d8757 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.265554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5c53-81b0-4eaa-8855-7c352f0e2436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.266220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5c53-81b0-4eaa-8855-7c352f0e2436 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.266502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5c53-81b0-4eaa-8855-7c352f0e2436 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.266776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f5c53-81b0-4eaa-8855-7c352f0e2436 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.267491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f5c53-81b0-4eaa-8855-7c352f0e2436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.269112 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f5c53-81b0-4eaa-8855-7c352f0e2436 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.279359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1024/2032] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:15.279359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5c53-81b0-4eaa-8855-7c352f0e2436 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.290548 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f5c53-81b0-4eaa-8855-7c352f0e2436 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.295119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f4c1a-441f-458f-ba07-b568907f4e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.295787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4c1a-441f-458f-ba07-b568907f4e62 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.296075 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4c1a-441f-458f-ba07-b568907f4e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.296353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4c1a-441f-458f-ba07-b568907f4e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.297068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f4c1a-441f-458f-ba07-b568907f4e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.298726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f4c1a-441f-458f-ba07-b568907f4e62 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.311296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1025/2033] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:15.311296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f4c1a-441f-458f-ba07-b568907f4e62 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.325084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f4c1a-441f-458f-ba07-b568907f4e62 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.325084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4197624-21af-4695-8929-0a152342d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.325360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4197624-21af-4695-8929-0a152342d445 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.325590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4197624-21af-4695-8929-0a152342d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.325900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4197624-21af-4695-8929-0a152342d445 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.326584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4197624-21af-4695-8929-0a152342d445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.328876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4197624-21af-4695-8929-0a152342d445 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.347553 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1009/2034] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:15 2022] PUT /identity/v3/projects/82c346a3f6214b6bbecd808e8b8965d3/users/26789e1c35ef4fbca36cb34da64406ff/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:15.349248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ca715-f211-44db-9996-f8fcc925fad4 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.411424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ca715-f211-44db-9996-f8fcc925fad4 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.414824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1026/2035] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:15 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:15.414824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4197624-21af-4695-8929-0a152342d445 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.470561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c0917-c0f4-4007-9eac-bd3427954b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.471450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c0917-c0f4-4007-9eac-bd3427954b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.471771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c0917-c0f4-4007-9eac-bd3427954b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.472047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c0917-c0f4-4007-9eac-bd3427954b0c admin admin] PATH_INFO: `/v3/projects/fbce6b42da624e65930ed3df733b4ce2/users/afc46c62718147f6b09b9188907a9c7e/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.473993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c0917-c0f4-4007-9eac-bd3427954b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbce6b42da624e65930ed3df733b4ce2, user_id=afc46c62718147f6b09b9188907a9c7e, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.476665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c0917-c0f4-4007-9eac-bd3427954b0c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.476805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4197624-21af-4695-8929-0a152342d445 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.481755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015e63-2e6d-44a1-ad15-5a560a588faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.482465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015e63-2e6d-44a1-ad15-5a560a588faf admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.482750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015e63-2e6d-44a1-ad15-5a560a588faf admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.483031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015e63-2e6d-44a1-ad15-5a560a588faf admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.483773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015e63-2e6d-44a1-ad15-5a560a588faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.485371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015e63-2e6d-44a1-ad15-5a560a588faf admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.487433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1010/2036] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:15 2022] PUT /identity/v3/projects/fbce6b42da624e65930ed3df733b4ce2/users/afc46c62718147f6b09b9188907a9c7e/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:15.488001 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c0917-c0f4-4007-9eac-bd3427954b0c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.495892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1027/2037] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:15.497142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015e63-2e6d-44a1-ad15-5a560a588faf admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.515187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015e63-2e6d-44a1-ad15-5a560a588faf admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.554716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c0917-c0f4-4007-9eac-bd3427954b0c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.560257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65ab71-ba43-4127-a381-a36d030ccab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.560936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65ab71-ba43-4127-a381-a36d030ccab5 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.561222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65ab71-ba43-4127-a381-a36d030ccab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.561634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65ab71-ba43-4127-a381-a36d030ccab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.562371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65ab71-ba43-4127-a381-a36d030ccab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.564012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65ab71-ba43-4127-a381-a36d030ccab5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.578106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1011/2038] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:15.578106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44355c-6485-467b-9e99-265911e87c9b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.578106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44355c-6485-467b-9e99-265911e87c9b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.578106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44355c-6485-467b-9e99-265911e87c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.584039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4efa96-0787-4cf1-9b11-bd58369819fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.584039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4efa96-0787-4cf1-9b11-bd58369819fc admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.584039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4efa96-0787-4cf1-9b11-bd58369819fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.584302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4efa96-0787-4cf1-9b11-bd58369819fc admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.586391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4efa96-0787-4cf1-9b11-bd58369819fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.588434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4efa96-0787-4cf1-9b11-bd58369819fc admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.605755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-2a44355c-6485-467b-9e99-265911e87c9b None None] MFA Rules not processed for user `afc46c62718147f6b09b9188907a9c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:15.606990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-2a44355c-6485-467b-9e99-265911e87c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:15.638034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:15.686241 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1012/2039] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:15.687114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44355c-6485-467b-9e99-265911e87c9b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.697893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44355c-6485-467b-9e99-265911e87c9b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.702811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76373c9-cecd-47d1-97c2-88354b361dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.703697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76373c9-cecd-47d1-97c2-88354b361dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.704029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76373c9-cecd-47d1-97c2-88354b361dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.704288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76373c9-cecd-47d1-97c2-88354b361dfa admin admin] PATH_INFO: `/v3/projects/a3b9750bb461466297af4517f8203fc7/users/816f791a149346fea8a815c1439485cc/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.709224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1028/2040] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:15 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:15.710698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4efa96-0787-4cf1-9b11-bd58369819fc admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.721214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76373c9-cecd-47d1-97c2-88354b361dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b9750bb461466297af4517f8203fc7, user_id=816f791a149346fea8a815c1439485cc, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.723135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4efa96-0787-4cf1-9b11-bd58369819fc admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.724726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76373c9-cecd-47d1-97c2-88354b361dfa admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.727886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc44555-93d2-4cdf-a916-82b4a0d2e18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.728939 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc44555-93d2-4cdf-a916-82b4a0d2e18f admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.729225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc44555-93d2-4cdf-a916-82b4a0d2e18f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.729504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc44555-93d2-4cdf-a916-82b4a0d2e18f admin admin] PATH_INFO: `/v3/projects/82c346a3f6214b6bbecd808e8b8965d3/users/26789e1c35ef4fbca36cb34da64406ff/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.731478 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc44555-93d2-4cdf-a916-82b4a0d2e18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c346a3f6214b6bbecd808e8b8965d3, user_id=26789e1c35ef4fbca36cb34da64406ff, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.734437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc44555-93d2-4cdf-a916-82b4a0d2e18f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.745200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1029/2041] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:15 2022] PUT /identity/v3/projects/82c346a3f6214b6bbecd808e8b8965d3/users/26789e1c35ef4fbca36cb34da64406ff/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:15.746424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215edbaf-935a-4f60-9161-827c6979b747 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.746715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215edbaf-935a-4f60-9161-827c6979b747 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.746992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215edbaf-935a-4f60-9161-827c6979b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.773045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-215edbaf-935a-4f60-9161-827c6979b747 None None] MFA Rules not processed for user `d05983b7dd5c4018a7c2dbfcfadbd5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:15.774354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-215edbaf-935a-4f60-9161-827c6979b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:15.837332 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1030/2042] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:15.838792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215edbaf-935a-4f60-9161-827c6979b747 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.840980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-215edbaf-935a-4f60-9161-827c6979b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:15.845447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1013/2043] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:15 2022] PUT /identity/v3/projects/a3b9750bb461466297af4517f8203fc7/users/816f791a149346fea8a815c1439485cc/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:15.846408 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76373c9-cecd-47d1-97c2-88354b361dfa admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:15.902213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215edbaf-935a-4f60-9161-827c6979b747 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.910916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76373c9-cecd-47d1-97c2-88354b361dfa admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:15.917366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffecec-e9d9-420a-9cdc-e67cfb1bd5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.918173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffecec-e9d9-420a-9cdc-e67cfb1bd5ab admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.918463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffecec-e9d9-420a-9cdc-e67cfb1bd5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.918743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffecec-e9d9-420a-9cdc-e67cfb1bd5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.919466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffecec-e9d9-420a-9cdc-e67cfb1bd5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:15.921110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffecec-e9d9-420a-9cdc-e67cfb1bd5ab admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:15.932948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1014/2044] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:15.934676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541706d5-3698-4dfc-9f99-aeb141aef7cb None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.935181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541706d5-3698-4dfc-9f99-aeb141aef7cb None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.935668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541706d5-3698-4dfc-9f99-aeb141aef7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.955675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f500-51b1-4f71-ae95-8774e46e4e3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:15.956653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f500-51b1-4f71-ae95-8774e46e4e3c service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:15.956963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f500-51b1-4f71-ae95-8774e46e4e3c service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:15.957236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f500-51b1-4f71-ae95-8774e46e4e3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:15.965252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-541706d5-3698-4dfc-9f99-aeb141aef7cb None None] MFA Rules not processed for user `26789e1c35ef4fbca36cb34da64406ff`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:15.966949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-541706d5-3698-4dfc-9f99-aeb141aef7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:16.023175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f500-51b1-4f71-ae95-8774e46e4e3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.024881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f500-51b1-4f71-ae95-8774e46e4e3c service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.043918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1031/2045] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:16.044643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f500-51b1-4f71-ae95-8774e46e4e3c service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.046010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-76e4f500-51b1-4f71-ae95-8774e46e4e3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:16.061976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1015/2046] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:16.061976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fe7e-2f7b-480d-82e2-1874426f8451 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.062254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f500-51b1-4f71-ae95-8774e46e4e3c service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.062350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fe7e-2f7b-480d-82e2-1874426f8451 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.062350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fe7e-2f7b-480d-82e2-1874426f8451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.066753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736385-bd38-4497-a6fe-579caea553bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.067406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736385-bd38-4497-a6fe-579caea553bb admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.067690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736385-bd38-4497-a6fe-579caea553bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.068024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736385-bd38-4497-a6fe-579caea553bb admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.068715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20736385-bd38-4497-a6fe-579caea553bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.070806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20736385-bd38-4497-a6fe-579caea553bb admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.089708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8f27fe7e-2f7b-480d-82e2-1874426f8451 None None] MFA Rules not processed for user `816f791a149346fea8a815c1439485cc`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:16.090934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8f27fe7e-2f7b-480d-82e2-1874426f8451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:16.155944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1016/2047] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:16.156936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27fe7e-2f7b-480d-82e2-1874426f8451 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.164654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1032/2048] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:16 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:16.165049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736385-bd38-4497-a6fe-579caea553bb admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.166807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-20736385-bd38-4497-a6fe-579caea553bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:16.167576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27fe7e-2f7b-480d-82e2-1874426f8451 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.211932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:16.223066 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736385-bd38-4497-a6fe-579caea553bb admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.225373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce99552-59b8-4618-80d4-dfb90fe5ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.226096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99552-59b8-4618-80d4-dfb90fe5ea9a admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.226381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99552-59b8-4618-80d4-dfb90fe5ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.226688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99552-59b8-4618-80d4-dfb90fe5ea9a admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.226883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f3f3-fda9-4017-aef0-783224e0608a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.227420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce99552-59b8-4618-80d4-dfb90fe5ea9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.227530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f3f3-fda9-4017-aef0-783224e0608a service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.227811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f3f3-fda9-4017-aef0-783224e0608a service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.228086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f3f3-fda9-4017-aef0-783224e0608a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.229059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce99552-59b8-4618-80d4-dfb90fe5ea9a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.239893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1017/2049] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:16.240771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce99552-59b8-4618-80d4-dfb90fe5ea9a admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.254160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce99552-59b8-4618-80d4-dfb90fe5ea9a admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.259256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9c3a-af6a-49f9-a7cd-eb97120af15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.260518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9c3a-af6a-49f9-a7cd-eb97120af15c admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.260801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9c3a-af6a-49f9-a7cd-eb97120af15c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.261084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9c3a-af6a-49f9-a7cd-eb97120af15c admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.262032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9c3a-af6a-49f9-a7cd-eb97120af15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.263967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9c3a-af6a-49f9-a7cd-eb97120af15c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.294589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20f3f3-fda9-4017-aef0-783224e0608a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.296076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20f3f3-fda9-4017-aef0-783224e0608a service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.305493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1033/2050] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:16.306957 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f3f3-fda9-4017-aef0-783224e0608a service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.317081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f3f3-fda9-4017-aef0-783224e0608a service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.321537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2c3b-3211-411b-ac03-fb5e20cc24f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.322978 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2c3b-3211-411b-ac03-fb5e20cc24f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.323313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2c3b-3211-411b-ac03-fb5e20cc24f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.323593 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2c3b-3211-411b-ac03-fb5e20cc24f8 admin admin] PATH_INFO: `/v3/projects/0b8e190d0b0c4fdcabec7d6d495afc5b/users/33cf07e5e6fc499dbda2f3a8851ec45d/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.339616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe2c3b-3211-411b-ac03-fb5e20cc24f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8e190d0b0c4fdcabec7d6d495afc5b, user_id=33cf07e5e6fc499dbda2f3a8851ec45d, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.342300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe2c3b-3211-411b-ac03-fb5e20cc24f8 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.343052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1018/2051] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:16 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:16.349517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9c3a-af6a-49f9-a7cd-eb97120af15c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.359549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9c3a-af6a-49f9-a7cd-eb97120af15c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.363226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8518c-f93e-4eeb-bde0-6dd892ef0369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.363864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8518c-f93e-4eeb-bde0-6dd892ef0369 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.364148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8518c-f93e-4eeb-bde0-6dd892ef0369 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.364422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8518c-f93e-4eeb-bde0-6dd892ef0369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.422648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8518c-f93e-4eeb-bde0-6dd892ef0369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.424188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8518c-f93e-4eeb-bde0-6dd892ef0369 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.433455 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1019/2052] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:16.434234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8518c-f93e-4eeb-bde0-6dd892ef0369 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.444196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8518c-f93e-4eeb-bde0-6dd892ef0369 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.449457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05843526-2731-4d39-928f-8153996630e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.450107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843526-2731-4d39-928f-8153996630e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.450387 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843526-2731-4d39-928f-8153996630e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.450794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843526-2731-4d39-928f-8153996630e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.451503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05843526-2731-4d39-928f-8153996630e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.453127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05843526-2731-4d39-928f-8153996630e2 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.462634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1034/2053] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:16 2022] PUT /identity/v3/projects/0b8e190d0b0c4fdcabec7d6d495afc5b/users/33cf07e5e6fc499dbda2f3a8851ec45d/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:16.467052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1020/2054] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:16.467859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05843526-2731-4d39-928f-8153996630e2 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.471635 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2c3b-3211-411b-ac03-fb5e20cc24f8 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.477703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05843526-2731-4d39-928f-8153996630e2 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.529034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2c3b-3211-411b-ac03-fb5e20cc24f8 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.532706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22484c1e-e3e1-4904-85ad-f0b9a81be639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.533352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22484c1e-e3e1-4904-85ad-f0b9a81be639 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.533712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22484c1e-e3e1-4904-85ad-f0b9a81be639 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.533961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22484c1e-e3e1-4904-85ad-f0b9a81be639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.534968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.535859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.536140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.536416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] PATH_INFO: `/v3/users/816f791a149346fea8a815c1439485cc` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.537580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816f791a149346fea8a815c1439485cc)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.539483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.589889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22484c1e-e3e1-4904-85ad-f0b9a81be639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.591334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22484c1e-e3e1-4904-85ad-f0b9a81be639 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.600088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1035/2055] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:16.600886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22484c1e-e3e1-4904-85ad-f0b9a81be639 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.608667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22484c1e-e3e1-4904-85ad-f0b9a81be639 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.612411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3abde-727f-4eeb-bc64-f4d93af1a471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.613083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3abde-727f-4eeb-bc64-f4d93af1a471 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.613399 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3abde-727f-4eeb-bc64-f4d93af1a471 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.613696 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3abde-727f-4eeb-bc64-f4d93af1a471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.669949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3abde-727f-4eeb-bc64-f4d93af1a471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.671406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3abde-727f-4eeb-bc64-f4d93af1a471 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.680152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1036/2056] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:16.681951 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ba2c-d97f-4400-a203-b8fb9ddda3d6 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.682250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ba2c-d97f-4400-a203-b8fb9ddda3d6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.682530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ba2c-d97f-4400-a203-b8fb9ddda3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.707441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-2931ba2c-d97f-4400-a203-b8fb9ddda3d6 None None] MFA Rules not processed for user `33cf07e5e6fc499dbda2f3a8851ec45d`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:16.708677 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2931ba2c-d97f-4400-a203-b8fb9ddda3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:16.762021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816f791a149346fea8a815c1439485cc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:16.768418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816f791a149346fea8a815c1439485cc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:16.774614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1037/2057] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:16.775502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ba2c-d97f-4400-a203-b8fb9ddda3d6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.785455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931ba2c-d97f-4400-a203-b8fb9ddda3d6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:16.790055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806600a6-84a5-4fce-9838-eabdfb7e6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:16.791431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806600a6-84a5-4fce-9838-eabdfb7e6813 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.791752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806600a6-84a5-4fce-9838-eabdfb7e6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.792052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806600a6-84a5-4fce-9838-eabdfb7e6813 admin admin] PATH_INFO: `/v3/projects/944ca37607d04ae29c5dd35e708cc086/users/be6465bce2f548bdad2579c5518a93be/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.808223 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806600a6-84a5-4fce-9838-eabdfb7e6813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944ca37607d04ae29c5dd35e708cc086, user_id=be6465bce2f548bdad2579c5518a93be, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:16.810976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806600a6-84a5-4fce-9838-eabdfb7e6813 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:16.890225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816f791a149346fea8a815c1439485cc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:16.897411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816f791a149346fea8a815c1439485cc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:16.909304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816f791a149346fea8a815c1439485cc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:16.915141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1021/2058] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:16 2022] DELETE /identity/v3/users/816f791a149346fea8a815c1439485cc => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:16.916411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:16.917811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:16.944411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1038/2059] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:16 2022] PUT /identity/v3/projects/944ca37607d04ae29c5dd35e708cc086/users/be6465bce2f548bdad2579c5518a93be/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:16.950357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7cb6c-a1be-473d-9c41-20d0cdf49004 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:16.950908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7cb6c-a1be-473d-9c41-20d0cdf49004 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:16.951529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7cb6c-a1be-473d-9c41-20d0cdf49004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:16.976493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-28a7cb6c-a1be-473d-9c41-20d0cdf49004 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:16.977609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-28a7cb6c-a1be-473d-9c41-20d0cdf49004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:16.984567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e85cd-7eb5-4a3a-a27e-59a013cf5841 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.042863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e36f49-c924-4ed2-9675-69f502f74250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.043184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e36f49-c924-4ed2-9675-69f502f74250 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.043469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e36f49-c924-4ed2-9675-69f502f74250 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.043818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e36f49-c924-4ed2-9675-69f502f74250 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.044475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e36f49-c924-4ed2-9675-69f502f74250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.046387 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e36f49-c924-4ed2-9675-69f502f74250 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.051907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1039/2060] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:17.053090 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7cb6c-a1be-473d-9c41-20d0cdf49004 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.056603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:17.057736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-28a7cb6c-a1be-473d-9c41-20d0cdf49004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:17.072050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7cb6c-a1be-473d-9c41-20d0cdf49004 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.076900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716083c4-24f0-43a4-b873-566116c46c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.088495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716083c4-24f0-43a4-b873-566116c46c26 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.088495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716083c4-24f0-43a4-b873-566116c46c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.088495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716083c4-24f0-43a4-b873-566116c46c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.088495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716083c4-24f0-43a4-b873-566116c46c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.088495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716083c4-24f0-43a4-b873-566116c46c26 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.097156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1040/2061] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:17.098211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716083c4-24f0-43a4-b873-566116c46c26 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.100005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-716083c4-24f0-43a4-b873-566116c46c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:17.164873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1022/2062] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:16 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:17.167513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e36f49-c924-4ed2-9675-69f502f74250 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.178382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716083c4-24f0-43a4-b873-566116c46c26 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.235032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e36f49-c924-4ed2-9675-69f502f74250 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.241637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeede5-bf3c-4704-9682-574517f13ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.242560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeede5-bf3c-4704-9682-574517f13ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.242823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeede5-bf3c-4704-9682-574517f13ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.243104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeede5-bf3c-4704-9682-574517f13ba8 admin admin] PATH_INFO: `/v3/projects/944ca37607d04ae29c5dd35e708cc086/users/be6465bce2f548bdad2579c5518a93be/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.245141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeede5-bf3c-4704-9682-574517f13ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944ca37607d04ae29c5dd35e708cc086, user_id=be6465bce2f548bdad2579c5518a93be, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.247273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90ac71-2252-4d89-ac6a-add8f063d05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.247924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeede5-bf3c-4704-9682-574517f13ba8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.248022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90ac71-2252-4d89-ac6a-add8f063d05f service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.248230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90ac71-2252-4d89-ac6a-add8f063d05f service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.248508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90ac71-2252-4d89-ac6a-add8f063d05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.258454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1023/2063] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:17 2022] PUT /identity/v3/projects/944ca37607d04ae29c5dd35e708cc086/users/be6465bce2f548bdad2579c5518a93be/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:17.259384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeede5-bf3c-4704-9682-574517f13ba8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.259998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90ac71-2252-4d89-ac6a-add8f063d05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.261822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90ac71-2252-4d89-ac6a-add8f063d05f service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.272552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1041/2064] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:17.284093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:17.325594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeede5-bf3c-4704-9682-574517f13ba8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.330421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f6be8-afd7-46d1-82be-5438edf427f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.331210 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f6be8-afd7-46d1-82be-5438edf427f5 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.331491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f6be8-afd7-46d1-82be-5438edf427f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.331791 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f6be8-afd7-46d1-82be-5438edf427f5 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.332485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f6be8-afd7-46d1-82be-5438edf427f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.334396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f6be8-afd7-46d1-82be-5438edf427f5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.486975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1024/2065] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:17 2022] POST /identity/v3/users => generated 300 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:17.488435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90ac71-2252-4d89-ac6a-add8f063d05f service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.500280 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90ac71-2252-4d89-ac6a-add8f063d05f service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.504932 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d13a-e43a-4c7c-ae54-2fe77defb4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.505617 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d13a-e43a-4c7c-ae54-2fe77defb4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.505907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d13a-e43a-4c7c-ae54-2fe77defb4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.506187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d13a-e43a-4c7c-ae54-2fe77defb4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.507216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d13a-e43a-4c7c-ae54-2fe77defb4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.509827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d13a-e43a-4c7c-ae54-2fe77defb4f0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.527600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1042/2066] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:17.528902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f6be8-afd7-46d1-82be-5438edf427f5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.540517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f6be8-afd7-46d1-82be-5438edf427f5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.547644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a6fe-47b5-4785-9055-988d5996b433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.548747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a6fe-47b5-4785-9055-988d5996b433 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.549201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a6fe-47b5-4785-9055-988d5996b433 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.549556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a6fe-47b5-4785-9055-988d5996b433 admin admin] PATH_INFO: `/v3/projects/591c529065aa4a9496c43fbb8c2a9df8/users/b98a4a919d5f4d1dbb20167a4ea713f8/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.567988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0a6fe-47b5-4785-9055-988d5996b433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591c529065aa4a9496c43fbb8c2a9df8, user_id=b98a4a919d5f4d1dbb20167a4ea713f8, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.569762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0a6fe-47b5-4785-9055-988d5996b433 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.650869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1025/2067] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:17 2022] PUT /identity/v3/projects/591c529065aa4a9496c43fbb8c2a9df8/users/b98a4a919d5f4d1dbb20167a4ea713f8/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:17.655245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d13a-e43a-4c7c-ae54-2fe77defb4f0 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.666949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d13a-e43a-4c7c-ae54-2fe77defb4f0 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.726124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2a4c9-c493-477f-abd8-1bd32ea014da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.726919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a4c9-c493-477f-abd8-1bd32ea014da admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.727209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a4c9-c493-477f-abd8-1bd32ea014da admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.727491 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a4c9-c493-477f-abd8-1bd32ea014da admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.728792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2a4c9-c493-477f-abd8-1bd32ea014da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.730519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2a4c9-c493-477f-abd8-1bd32ea014da admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.740787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1043/2068] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:17.745365 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a6fe-47b5-4785-9055-988d5996b433 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.755444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a6fe-47b5-4785-9055-988d5996b433 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.760155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0557a76-9b39-48f5-8d5c-78babc32d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.761024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0557a76-9b39-48f5-8d5c-78babc32d488 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.761306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0557a76-9b39-48f5-8d5c-78babc32d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.761838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0557a76-9b39-48f5-8d5c-78babc32d488 admin admin] PATH_INFO: `/v3/projects/591c529065aa4a9496c43fbb8c2a9df8/users/b98a4a919d5f4d1dbb20167a4ea713f8/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.763832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0557a76-9b39-48f5-8d5c-78babc32d488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591c529065aa4a9496c43fbb8c2a9df8, user_id=b98a4a919d5f4d1dbb20167a4ea713f8, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.766468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0557a76-9b39-48f5-8d5c-78babc32d488 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.777146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1026/2069] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:17 2022] PUT /identity/v3/projects/591c529065aa4a9496c43fbb8c2a9df8/users/b98a4a919d5f4d1dbb20167a4ea713f8/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:17.788139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0579-f96b-4c98-9465-0c59ccbfaf8c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.788432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0579-f96b-4c98-9465-0c59ccbfaf8c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.788720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0579-f96b-4c98-9465-0c59ccbfaf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.800403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0557a76-9b39-48f5-8d5c-78babc32d488 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.802709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f0557a76-9b39-48f5-8d5c-78babc32d488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:17.835896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-991e0579-f96b-4c98-9465-0c59ccbfaf8c None None] MFA Rules not processed for user `b98a4a919d5f4d1dbb20167a4ea713f8`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:17.838206 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-991e0579-f96b-4c98-9465-0c59ccbfaf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:17.877662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0557a76-9b39-48f5-8d5c-78babc32d488 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.883180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.884157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.884549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.884933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] PATH_INFO: `/v3/projects/a3b9750bb461466297af4517f8203fc7` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.886250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b9750bb461466297af4517f8203fc7)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.888563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.916757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1044/2070] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:17.928247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e0579-f96b-4c98-9465-0c59ccbfaf8c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.929665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-991e0579-f96b-4c98-9465-0c59ccbfaf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:17.988296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e0579-f96b-4c98-9465-0c59ccbfaf8c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.992098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bd930-6179-4bd9-b29d-2ad70d40aae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.992823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bd930-6179-4bd9-b29d-2ad70d40aae5 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.993177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bd930-6179-4bd9-b29d-2ad70d40aae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.993549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bd930-6179-4bd9-b29d-2ad70d40aae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.003597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bd930-6179-4bd9-b29d-2ad70d40aae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:18.005261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bd930-6179-4bd9-b29d-2ad70d40aae5 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:18.015157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b9750bb461466297af4517f8203fc7', 'request_id': 'req-1654c48e-bfd9-45a0-be70-a0f5af838a21'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:18.016230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1045/2071] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:18.022783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b9750bb461466297af4517f8203fc7', 'request_id': 'req-1654c48e-bfd9-45a0-be70-a0f5af838a21'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:18.136175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b9750bb461466297af4517f8203fc7', 'request_id': 'req-1654c48e-bfd9-45a0-be70-a0f5af838a21'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:18.149500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] The token cache is being invalidate because project a3b9750bb461466297af4517f8203fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:18.149838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:18.150981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-1654c48e-bfd9-45a0-be70-a0f5af838a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:18.152796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1027/2072] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:17 2022] DELETE /identity/v3/projects/a3b9750bb461466297af4517f8203fc7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:18.157599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01efbe-973b-4fff-bde3-9985295451e1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:18.157897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01efbe-973b-4fff-bde3-9985295451e1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:18.158195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01efbe-973b-4fff-bde3-9985295451e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.177937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5a01efbe-973b-4fff-bde3-9985295451e1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:18.179139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5a01efbe-973b-4fff-bde3-9985295451e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:18.242015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1046/2073] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:18.250285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9e8f-99cd-414a-b7c8-6ec6c5325535 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:18.250793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9e8f-99cd-414a-b7c8-6ec6c5325535 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:18.250793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9e8f-99cd-414a-b7c8-6ec6c5325535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.283854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-a7da9e8f-99cd-414a-b7c8-6ec6c5325535 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:18.285696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a7da9e8f-99cd-414a-b7c8-6ec6c5325535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:18.307512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1028/2074] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:18.309018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01efbe-973b-4fff-bde3-9985295451e1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:18.320300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01efbe-973b-4fff-bde3-9985295451e1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:18.327233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f5927-61cb-4dc9-94f8-65e89e87cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:18.327964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f5927-61cb-4dc9-94f8-65e89e87cddf admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:18.329393 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f5927-61cb-4dc9-94f8-65e89e87cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:18.329393 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f5927-61cb-4dc9-94f8-65e89e87cddf admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.330312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f5927-61cb-4dc9-94f8-65e89e87cddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:18.331048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f5927-61cb-4dc9-94f8-65e89e87cddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:18.332462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f5927-61cb-4dc9-94f8-65e89e87cddf admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:18.348802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1047/2075] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:18.353751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9e8f-99cd-414a-b7c8-6ec6c5325535 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:18.363629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9e8f-99cd-414a-b7c8-6ec6c5325535 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:18.371019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6486d1-be58-409b-8452-8aed4acca134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:18.371776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6486d1-be58-409b-8452-8aed4acca134 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:18.372135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6486d1-be58-409b-8452-8aed4acca134 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:18.372479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6486d1-be58-409b-8452-8aed4acca134 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.373245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6486d1-be58-409b-8452-8aed4acca134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:18.375373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6486d1-be58-409b-8452-8aed4acca134 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:18.384924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:18.529259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1029/2076] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:18 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:18.533283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f5927-61cb-4dc9-94f8-65e89e87cddf admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:18.544769 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f5927-61cb-4dc9-94f8-65e89e87cddf admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:18.607965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe7cd-fd7e-40f4-aead-087e553c0d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:18.608639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe7cd-fd7e-40f4-aead-087e553c0d2a admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:18.608927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe7cd-fd7e-40f4-aead-087e553c0d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:18.609208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe7cd-fd7e-40f4-aead-087e553c0d2a admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.609908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effe7cd-fd7e-40f4-aead-087e553c0d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:18.611902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effe7cd-fd7e-40f4-aead-087e553c0d2a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:18.643585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:18.809589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1048/2077] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:18 2022] POST /identity/v3/users => generated 287 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:18.814247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6486d1-be58-409b-8452-8aed4acca134 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:18.824481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6486d1-be58-409b-8452-8aed4acca134 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:18.829156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b259e-0812-4ab5-ac37-f3d4b58a5a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:18.829794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b259e-0812-4ab5-ac37-f3d4b58a5a3a admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:18.830074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b259e-0812-4ab5-ac37-f3d4b58a5a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:18.830352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b259e-0812-4ab5-ac37-f3d4b58a5a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.831062 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b259e-0812-4ab5-ac37-f3d4b58a5a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:18.833000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b259e-0812-4ab5-ac37-f3d4b58a5a3a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:18.861093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1030/2078] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:18.864935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe7cd-fd7e-40f4-aead-087e553c0d2a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:18.875046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe7cd-fd7e-40f4-aead-087e553c0d2a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:18.879823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d8a3e-6408-44ae-b776-91dd50cf6d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:18.880487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8a3e-6408-44ae-b776-91dd50cf6d00 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:18.880773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8a3e-6408-44ae-b776-91dd50cf6d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:18.881053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8a3e-6408-44ae-b776-91dd50cf6d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.881775 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d8a3e-6408-44ae-b776-91dd50cf6d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:18.883572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d8a3e-6408-44ae-b776-91dd50cf6d00 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:18.894693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1049/2079] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:18.899308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b259e-0812-4ab5-ac37-f3d4b58a5a3a admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:18.909703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b259e-0812-4ab5-ac37-f3d4b58a5a3a admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:18.914208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f03927-dbf9-463b-b7b1-b6c638cc95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:18.915085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f03927-dbf9-463b-b7b1-b6c638cc95f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:18.915363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f03927-dbf9-463b-b7b1-b6c638cc95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:18.916300 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f03927-dbf9-463b-b7b1-b6c638cc95f3 admin admin] PATH_INFO: `/v3/projects/1734bf351b1a4f6b9429ca9d9bd18a40/users/32ebc6c6fe724d7083614d7f5fd38b50/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.936615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f03927-dbf9-463b-b7b1-b6c638cc95f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1734bf351b1a4f6b9429ca9d9bd18a40, user_id=32ebc6c6fe724d7083614d7f5fd38b50, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:18.937402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988ac3-f855-4193-a257-8b5a62825222 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:18.937709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988ac3-f855-4193-a257-8b5a62825222 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:18.938128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988ac3-f855-4193-a257-8b5a62825222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:18.939986 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f03927-dbf9-463b-b7b1-b6c638cc95f3 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:18.988928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7a988ac3-f855-4193-a257-8b5a62825222 None None] MFA Rules not processed for user `be6465bce2f548bdad2579c5518a93be`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:18.990297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7a988ac3-f855-4193-a257-8b5a62825222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:19.052980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1031/2080] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:18 2022] PUT /identity/v3/projects/1734bf351b1a4f6b9429ca9d9bd18a40/users/32ebc6c6fe724d7083614d7f5fd38b50/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:19.056903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d078-d552-4a53-89b2-e5cfe92a493c None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:19.057442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d078-d552-4a53-89b2-e5cfe92a493c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:19.057909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d078-d552-4a53-89b2-e5cfe92a493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:19.109622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1050/2081] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:19.111238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5528332-3f00-41f5-9d8c-2c1c8787d321 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:19.111533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5528332-3f00-41f5-9d8c-2c1c8787d321 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:19.111639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-5606d078-d552-4a53-89b2-e5cfe92a493c None None] MFA Rules not processed for user `32ebc6c6fe724d7083614d7f5fd38b50`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:19.111838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5528332-3f00-41f5-9d8c-2c1c8787d321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:19.113411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5606d078-d552-4a53-89b2-e5cfe92a493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:19.134695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c5528332-3f00-41f5-9d8c-2c1c8787d321 None None] MFA Rules not processed for user `d05983b7dd5c4018a7c2dbfcfadbd5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:19.136169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c5528332-3f00-41f5-9d8c-2c1c8787d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:19.189223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1032/2082] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:19.196554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1051/2083] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:19.206966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606d078-d552-4a53-89b2-e5cfe92a493c None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:19.208448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5606d078-d552-4a53-89b2-e5cfe92a493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:19.208879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5528332-3f00-41f5-9d8c-2c1c8787d321 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:19.210318 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c5528332-3f00-41f5-9d8c-2c1c8787d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:19.269915 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606d078-d552-4a53-89b2-e5cfe92a493c None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:19.274047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afcc42-405f-414c-add6-c160342b1ad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:19.274673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afcc42-405f-414c-add6-c160342b1ad2 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:19.275479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afcc42-405f-414c-add6-c160342b1ad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:19.275784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afcc42-405f-414c-add6-c160342b1ad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:19.285013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afcc42-405f-414c-add6-c160342b1ad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:19.286438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afcc42-405f-414c-add6-c160342b1ad2 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:19.294026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5528332-3f00-41f5-9d8c-2c1c8787d321 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:19.296338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1033/2084] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:19.299873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:19.300521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:19.300803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:19.301071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:19.302964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:19.314005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:19.315518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:19.325296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1052/2085] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:19.964517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afcc42-405f-414c-add6-c160342b1ad2 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:19.966739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-12afcc42-405f-414c-add6-c160342b1ad2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:19.979401 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afcc42-405f-414c-add6-c160342b1ad2 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:19.986190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec192718-467a-438d-8334-07860256debf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:19.987208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec192718-467a-438d-8334-07860256debf service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:19.987704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec192718-467a-438d-8334-07860256debf service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:19.988228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec192718-467a-438d-8334-07860256debf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:19.990473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ec192718-467a-438d-8334-07860256debf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:20.042787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:20.089427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec192718-467a-438d-8334-07860256debf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:20.090961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec192718-467a-438d-8334-07860256debf service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:20.101744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1034/2086] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:20.551859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:21.816200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:22.376284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:22.656222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:23.146675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:23.148352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:23.252682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc00f-706a-451f-aa84-29cfcc7e5aa1 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:23.259194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:23.260646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:23.261330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:23.261915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] PATH_INFO: `/v3/users/dc2e8080cd194e8ab00e16d3f2cf55f2` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:23.264644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2e8080cd194e8ab00e16d3f2cf55f2)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:23.266666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:23.497947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2e8080cd194e8ab00e16d3f2cf55f2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:23.498600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2e8080cd194e8ab00e16d3f2cf55f2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:23.505310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2e8080cd194e8ab00e16d3f2cf55f2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:23.564425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2e8080cd194e8ab00e16d3f2cf55f2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:23.579136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2e8080cd194e8ab00e16d3f2cf55f2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:23.585297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1053/2087] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:23 2022] DELETE /identity/v3/users/dc2e8080cd194e8ab00e16d3f2cf55f2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:23.591836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56e58b-734f-4395-9b26-0e1c7e5942dc None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:23.592285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56e58b-734f-4395-9b26-0e1c7e5942dc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:23.592480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56e58b-734f-4395-9b26-0e1c7e5942dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:23.610433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-6f56e58b-734f-4395-9b26-0e1c7e5942dc None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:23.611779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6f56e58b-734f-4395-9b26-0e1c7e5942dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:23.672488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1035/2088] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:23.681622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:23.683045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:23.739999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fce2f-7ad3-4a65-814c-810fd48170d5 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:23.743629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50e5cd-f23f-46f9-bba3-149f18c3ed31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:23.744317 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50e5cd-f23f-46f9-bba3-149f18c3ed31 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:23.744600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50e5cd-f23f-46f9-bba3-149f18c3ed31 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:23.744874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50e5cd-f23f-46f9-bba3-149f18c3ed31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:23.753738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50e5cd-f23f-46f9-bba3-149f18c3ed31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:23.755191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50e5cd-f23f-46f9-bba3-149f18c3ed31 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:23.765109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1054/2089] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:24.083832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:24.299656 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56e58b-734f-4395-9b26-0e1c7e5942dc None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:24.303713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6f56e58b-734f-4395-9b26-0e1c7e5942dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:24.319281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56e58b-734f-4395-9b26-0e1c7e5942dc None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:24.355119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:24.356034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:24.356304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:24.356579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] PATH_INFO: `/v3/projects/7786e5a3967f48bf85de58f3b83c8efb` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:24.357844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7786e5a3967f48bf85de58f3b83c8efb)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:24.359801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:24.528171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7786e5a3967f48bf85de58f3b83c8efb', 'request_id': 'req-dc462730-5637-4aa6-8966-42e6ea1c9862'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:24.536326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7786e5a3967f48bf85de58f3b83c8efb', 'request_id': 'req-dc462730-5637-4aa6-8966-42e6ea1c9862'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:24.605253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7786e5a3967f48bf85de58f3b83c8efb', 'request_id': 'req-dc462730-5637-4aa6-8966-42e6ea1c9862'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:24.617035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] The token cache is being invalidate because project 7786e5a3967f48bf85de58f3b83c8efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:24.617333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:24.617982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:24.619609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1036/2090] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:24 2022] DELETE /identity/v3/projects/7786e5a3967f48bf85de58f3b83c8efb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:24.623777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50e5cd-f23f-46f9-bba3-149f18c3ed31 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:24.633572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50e5cd-f23f-46f9-bba3-149f18c3ed31 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:24.694154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:24.695559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:24.696025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:24.696449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] PATH_INFO: `/v3/users/26789e1c35ef4fbca36cb34da64406ff` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:24.697976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26789e1c35ef4fbca36cb34da64406ff)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:24.700542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:24.776689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:24.940654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26789e1c35ef4fbca36cb34da64406ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:24.941551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26789e1c35ef4fbca36cb34da64406ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:24.950193 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26789e1c35ef4fbca36cb34da64406ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:25.045597 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:25.061486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26789e1c35ef4fbca36cb34da64406ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:25.074674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26789e1c35ef4fbca36cb34da64406ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:25.081324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1055/2091] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:24 2022] DELETE /identity/v3/users/26789e1c35ef4fbca36cb34da64406ff => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:25.738840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:25.739286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:25.766884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc462730-5637-4aa6-8966-42e6ea1c9862 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:25.832348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:25.833475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:25.833976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:25.834536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] PATH_INFO: `/v3/projects/82c346a3f6214b6bbecd808e8b8965d3` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:25.838065 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c346a3f6214b6bbecd808e8b8965d3)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:25.840384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:25.863677 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:25.866208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:25.937110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4598e-f1f2-470f-98b5-fdc2e82c4c63 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:25.941229 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e944-2c53-4996-9abf-a9a2b36b96cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:25.942227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e944-2c53-4996-9abf-a9a2b36b96cf service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:25.944270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e944-2c53-4996-9abf-a9a2b36b96cf service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:25.944270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e944-2c53-4996-9abf-a9a2b36b96cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:25.946059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9b35e944-2c53-4996-9abf-a9a2b36b96cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:26.047995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35e944-2c53-4996-9abf-a9a2b36b96cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:26.049935 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c346a3f6214b6bbecd808e8b8965d3', 'request_id': 'req-b60470a4-276b-4f33-839b-fee397716258'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:26.050364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35e944-2c53-4996-9abf-a9a2b36b96cf service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:26.066218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1056/2092] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:26.068712 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c346a3f6214b6bbecd808e8b8965d3', 'request_id': 'req-b60470a4-276b-4f33-839b-fee397716258'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:26.130695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c346a3f6214b6bbecd808e8b8965d3', 'request_id': 'req-b60470a4-276b-4f33-839b-fee397716258'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:26.145869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] The token cache is being invalidate because project 82c346a3f6214b6bbecd808e8b8965d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:26.145869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:26.145869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b60470a4-276b-4f33-839b-fee397716258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:26.147101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1037/2093] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:25 2022] DELETE /identity/v3/projects/82c346a3f6214b6bbecd808e8b8965d3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:26.153165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1299f78-86d2-4555-98ac-65a9176091bb None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:26.153658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1299f78-86d2-4555-98ac-65a9176091bb None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:26.154005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1299f78-86d2-4555-98ac-65a9176091bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:26.177169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-b1299f78-86d2-4555-98ac-65a9176091bb None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:26.178494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b1299f78-86d2-4555-98ac-65a9176091bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:26.242615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1057/2094] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:26.252889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49c0e-df76-472d-9147-33c289137056 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:26.253311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49c0e-df76-472d-9147-33c289137056 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:26.253810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49c0e-df76-472d-9147-33c289137056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:26.280848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4cc49c0e-df76-472d-9147-33c289137056 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:26.282861 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4cc49c0e-df76-472d-9147-33c289137056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:26.296249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1038/2095] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:26.297896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1299f78-86d2-4555-98ac-65a9176091bb None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:26.309537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1299f78-86d2-4555-98ac-65a9176091bb None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:26.316126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63184833-8cd5-4b77-956e-beaaf8042a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:26.316888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63184833-8cd5-4b77-956e-beaaf8042a81 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:26.317474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63184833-8cd5-4b77-956e-beaaf8042a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:26.317910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63184833-8cd5-4b77-956e-beaaf8042a81 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:26.318647 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63184833-8cd5-4b77-956e-beaaf8042a81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:26.318954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63184833-8cd5-4b77-956e-beaaf8042a81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:26.320650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63184833-8cd5-4b77-956e-beaaf8042a81 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:26.333351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1058/2096] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:26.339265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc49c0e-df76-472d-9147-33c289137056 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:26.349068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc49c0e-df76-472d-9147-33c289137056 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:26.357231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634886a2-29b7-4048-9a8a-45e0ae1ef31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:26.357231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634886a2-29b7-4048-9a8a-45e0ae1ef31c admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:26.357231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634886a2-29b7-4048-9a8a-45e0ae1ef31c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:26.357231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634886a2-29b7-4048-9a8a-45e0ae1ef31c admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:26.357592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634886a2-29b7-4048-9a8a-45e0ae1ef31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:26.359000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634886a2-29b7-4048-9a8a-45e0ae1ef31c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:26.473095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1039/2097] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:26 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:26.474708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63184833-8cd5-4b77-956e-beaaf8042a81 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:26.485017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63184833-8cd5-4b77-956e-beaaf8042a81 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:26.541907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd2ee9-7607-4430-892c-d9e66660961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:26.542521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd2ee9-7607-4430-892c-d9e66660961e admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:26.542798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd2ee9-7607-4430-892c-d9e66660961e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:26.543072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd2ee9-7607-4430-892c-d9e66660961e admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:26.543775 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd2ee9-7607-4430-892c-d9e66660961e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:26.545732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd2ee9-7607-4430-892c-d9e66660961e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:26.890053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1059/2098] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:26 2022] POST /identity/v3/users => generated 289 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:26.893661 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634886a2-29b7-4048-9a8a-45e0ae1ef31c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:26.904334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634886a2-29b7-4048-9a8a-45e0ae1ef31c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:26.909379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c84c-1938-4a12-91f3-03afc062142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:26.910063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c84c-1938-4a12-91f3-03afc062142f admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:26.910372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c84c-1938-4a12-91f3-03afc062142f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:26.910655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c84c-1938-4a12-91f3-03afc062142f admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:26.911477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c84c-1938-4a12-91f3-03afc062142f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:26.913147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c84c-1938-4a12-91f3-03afc062142f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:26.926645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1040/2099] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:26.927811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd2ee9-7607-4430-892c-d9e66660961e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:26.944481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd2ee9-7607-4430-892c-d9e66660961e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:26.949956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e820d6e-9d00-4779-999a-71053a039fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:26.954439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e820d6e-9d00-4779-999a-71053a039fdd admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:26.954439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e820d6e-9d00-4779-999a-71053a039fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:26.954439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e820d6e-9d00-4779-999a-71053a039fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:26.954439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e820d6e-9d00-4779-999a-71053a039fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:26.954439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e820d6e-9d00-4779-999a-71053a039fdd admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:26.967357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1060/2100] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:26.968587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c84c-1938-4a12-91f3-03afc062142f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:26.978988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c84c-1938-4a12-91f3-03afc062142f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:26.983925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5b90a-7fac-44e5-ad8d-6d3700eae3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:26.984804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5b90a-7fac-44e5-ad8d-6d3700eae3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:26.985088 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5b90a-7fac-44e5-ad8d-6d3700eae3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:26.985366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5b90a-7fac-44e5-ad8d-6d3700eae3c5 admin admin] PATH_INFO: `/v3/projects/7da8d2ef26e54cfea175cf8dcc6a327f/users/9e187e19fd214d9d88b61d23c69c4474/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:27.001973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5b90a-7fac-44e5-ad8d-6d3700eae3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da8d2ef26e54cfea175cf8dcc6a327f, user_id=9e187e19fd214d9d88b61d23c69c4474, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:27.004680 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5b90a-7fac-44e5-ad8d-6d3700eae3c5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:27.084338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1041/2101] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:26 2022] PUT /identity/v3/projects/7da8d2ef26e54cfea175cf8dcc6a327f/users/9e187e19fd214d9d88b61d23c69c4474/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:27.095014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e68a69-87c3-4942-9c65-febc75b0ba0e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:27.095376 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e68a69-87c3-4942-9c65-febc75b0ba0e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:27.095751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e68a69-87c3-4942-9c65-febc75b0ba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:27.122499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d2e68a69-87c3-4942-9c65-febc75b0ba0e None None] MFA Rules not processed for user `9e187e19fd214d9d88b61d23c69c4474`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:27.123845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d2e68a69-87c3-4942-9c65-febc75b0ba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:27.157863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:27.194236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1061/2102] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:27.198728 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5b90a-7fac-44e5-ad8d-6d3700eae3c5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:27.274093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5b90a-7fac-44e5-ad8d-6d3700eae3c5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:27.282180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc4867-63d7-49a1-ae83-4fcddfa8ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:27.283041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc4867-63d7-49a1-ae83-4fcddfa8ad3d admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:27.283332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc4867-63d7-49a1-ae83-4fcddfa8ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:27.283616 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc4867-63d7-49a1-ae83-4fcddfa8ad3d admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:27.284545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc4867-63d7-49a1-ae83-4fcddfa8ad3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:27.286492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc4867-63d7-49a1-ae83-4fcddfa8ad3d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:27.408193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1042/2103] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:27 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:27.409213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e68a69-87c3-4942-9c65-febc75b0ba0e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:27.423560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e68a69-87c3-4942-9c65-febc75b0ba0e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:27.439545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:27.484823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfe67d-ace8-4bf4-a10f-294bfa1e1e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:27.485492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfe67d-ace8-4bf4-a10f-294bfa1e1e37 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:27.485810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfe67d-ace8-4bf4-a10f-294bfa1e1e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:27.486083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfe67d-ace8-4bf4-a10f-294bfa1e1e37 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:27.486792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfe67d-ace8-4bf4-a10f-294bfa1e1e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:27.488879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfe67d-ace8-4bf4-a10f-294bfa1e1e37 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:27.615962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1062/2104] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:27 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:27.616164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc4867-63d7-49a1-ae83-4fcddfa8ad3d admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:27.639041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc4867-63d7-49a1-ae83-4fcddfa8ad3d admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:27.644253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dd60-eae3-4fa8-95f3-a84575a0be13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:27.645039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dd60-eae3-4fa8-95f3-a84575a0be13 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:27.645464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dd60-eae3-4fa8-95f3-a84575a0be13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:27.645895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dd60-eae3-4fa8-95f3-a84575a0be13 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:27.646692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3dd60-eae3-4fa8-95f3-a84575a0be13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:27.648550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3dd60-eae3-4fa8-95f3-a84575a0be13 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:27.660957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1043/2105] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:27.665192 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfe67d-ace8-4bf4-a10f-294bfa1e1e37 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:27.676067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfe67d-ace8-4bf4-a10f-294bfa1e1e37 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:27.680671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea0ef8-c96c-4b3e-9805-0d03729a9ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:27.681351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea0ef8-c96c-4b3e-9805-0d03729a9ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:27.681630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea0ef8-c96c-4b3e-9805-0d03729a9ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:27.681904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea0ef8-c96c-4b3e-9805-0d03729a9ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:27.682622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea0ef8-c96c-4b3e-9805-0d03729a9ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:27.684302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea0ef8-c96c-4b3e-9805-0d03729a9ae5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:27.694622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1063/2106] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:27.698871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dd60-eae3-4fa8-95f3-a84575a0be13 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:27.709979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dd60-eae3-4fa8-95f3-a84575a0be13 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:27.716911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825e085-74ad-46b7-93ca-3c9616cfdbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:27.717733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825e085-74ad-46b7-93ca-3c9616cfdbb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:27.718020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825e085-74ad-46b7-93ca-3c9616cfdbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:27.718300 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825e085-74ad-46b7-93ca-3c9616cfdbb4 admin admin] PATH_INFO: `/v3/projects/eb11d535e6034f2eaa5c1805956df40e/users/bc5326e06953464884173a0adc0adc5e/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:27.735429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825e085-74ad-46b7-93ca-3c9616cfdbb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb11d535e6034f2eaa5c1805956df40e, user_id=bc5326e06953464884173a0adc0adc5e, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:27.738170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825e085-74ad-46b7-93ca-3c9616cfdbb4 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:27.826710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1044/2107] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:27 2022] PUT /identity/v3/projects/eb11d535e6034f2eaa5c1805956df40e/users/bc5326e06953464884173a0adc0adc5e/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:27.837810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76b1a5-2ff1-4f13-958f-77b291250b99 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:27.838103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76b1a5-2ff1-4f13-958f-77b291250b99 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:27.838380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76b1a5-2ff1-4f13-958f-77b291250b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:27.867195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-3a76b1a5-2ff1-4f13-958f-77b291250b99 None None] MFA Rules not processed for user `bc5326e06953464884173a0adc0adc5e`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:27.868443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3a76b1a5-2ff1-4f13-958f-77b291250b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:27.902503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825e085-74ad-46b7-93ca-3c9616cfdbb4 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:27.906219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9825e085-74ad-46b7-93ca-3c9616cfdbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:27.996873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825e085-74ad-46b7-93ca-3c9616cfdbb4 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:28.002677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:28.004066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.004568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.004990 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] PATH_INFO: `/v3/users/457895b726f04319a34aa0a5e3e8289b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.009807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=457895b726f04319a34aa0a5e3e8289b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:28.009807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:28.021833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1064/2108] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:28.026745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76b1a5-2ff1-4f13-958f-77b291250b99 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:28.048086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76b1a5-2ff1-4f13-958f-77b291250b99 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:28.061082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac89d0f-e80e-4436-9034-ee50572a8b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:28.061082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac89d0f-e80e-4436-9034-ee50572a8b4d admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.061082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac89d0f-e80e-4436-9034-ee50572a8b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.061082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac89d0f-e80e-4436-9034-ee50572a8b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.061385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac89d0f-e80e-4436-9034-ee50572a8b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:28.061385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac89d0f-e80e-4436-9034-ee50572a8b4d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:28.147784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1065/2109] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:28 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:28.151207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac89d0f-e80e-4436-9034-ee50572a8b4d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:28.214190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac89d0f-e80e-4436-9034-ee50572a8b4d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:28.219316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc106a-8dfd-463e-bfb9-a2d4630c3a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:28.220195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc106a-8dfd-463e-bfb9-a2d4630c3a65 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.220479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc106a-8dfd-463e-bfb9-a2d4630c3a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.220785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc106a-8dfd-463e-bfb9-a2d4630c3a65 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.221435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc106a-8dfd-463e-bfb9-a2d4630c3a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:28.223395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc106a-8dfd-463e-bfb9-a2d4630c3a65 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:28.251066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457895b726f04319a34aa0a5e3e8289b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:28.251715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457895b726f04319a34aa0a5e3e8289b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:28.301770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1066/2110] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:28 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:28.305965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc106a-8dfd-463e-bfb9-a2d4630c3a65 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:28.316325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc106a-8dfd-463e-bfb9-a2d4630c3a65 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:28.321125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b3029-7a39-4ff6-afe8-7cefc18eaf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:28.322091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b3029-7a39-4ff6-afe8-7cefc18eaf80 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.322091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b3029-7a39-4ff6-afe8-7cefc18eaf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.322432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b3029-7a39-4ff6-afe8-7cefc18eaf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.323770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b3029-7a39-4ff6-afe8-7cefc18eaf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:28.324851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457895b726f04319a34aa0a5e3e8289b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:28.325409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b3029-7a39-4ff6-afe8-7cefc18eaf80 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:28.335527 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457895b726f04319a34aa0a5e3e8289b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:28.342145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1067/2111] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:28.346465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b3029-7a39-4ff6-afe8-7cefc18eaf80 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:28.358146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b3029-7a39-4ff6-afe8-7cefc18eaf80 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:28.360176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a79f308e-355b-45b3-bd3e-3b6861b8e51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457895b726f04319a34aa0a5e3e8289b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:28.363712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac2af1-ee7f-4d7b-8359-859ac98f3b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:28.369645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac2af1-ee7f-4d7b-8359-859ac98f3b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.369645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac2af1-ee7f-4d7b-8359-859ac98f3b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.369645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac2af1-ee7f-4d7b-8359-859ac98f3b13 admin admin] PATH_INFO: `/v3/projects/abb83ff8068c419782be144cf9428242/users/681eb2876dca4ee7be76a02dbc6651a8/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.370115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1045/2112] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:27 2022] DELETE /identity/v3/users/457895b726f04319a34aa0a5e3e8289b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:28.373147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d18b53-dca6-44f5-a0b6-495e94f31955 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.375598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d18b53-dca6-44f5-a0b6-495e94f31955 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.377650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d18b53-dca6-44f5-a0b6-495e94f31955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.383647 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac2af1-ee7f-4d7b-8359-859ac98f3b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb83ff8068c419782be144cf9428242, user_id=681eb2876dca4ee7be76a02dbc6651a8, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:28.387045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac2af1-ee7f-4d7b-8359-859ac98f3b13 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:28.405761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-52d18b53-dca6-44f5-a0b6-495e94f31955 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:28.406988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-52d18b53-dca6-44f5-a0b6-495e94f31955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:28.470993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1046/2113] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:28.483825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d18b53-dca6-44f5-a0b6-495e94f31955 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:28.486724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-52d18b53-dca6-44f5-a0b6-495e94f31955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:28.488462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1068/2114] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:28 2022] PUT /identity/v3/projects/abb83ff8068c419782be144cf9428242/users/681eb2876dca4ee7be76a02dbc6651a8/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:28.499064 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac2af1-ee7f-4d7b-8359-859ac98f3b13 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:28.500831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-28ac2af1-ee7f-4d7b-8359-859ac98f3b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:28.566821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d18b53-dca6-44f5-a0b6-495e94f31955 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:28.576549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac2af1-ee7f-4d7b-8359-859ac98f3b13 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:28.581714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b394b15-0b63-485a-87f0-48aaabb67e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:28.582421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b394b15-0b63-485a-87f0-48aaabb67e28 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.582711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b394b15-0b63-485a-87f0-48aaabb67e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.583030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b394b15-0b63-485a-87f0-48aaabb67e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.584038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b394b15-0b63-485a-87f0-48aaabb67e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:28.585797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b394b15-0b63-485a-87f0-48aaabb67e28 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:28.599964 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1069/2115] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:28.605013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b394b15-0b63-485a-87f0-48aaabb67e28 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:28.617928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b394b15-0b63-485a-87f0-48aaabb67e28 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:28.623660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c7d8a-d26f-49f9-8801-ed372754466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:28.625679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7d8a-d26f-49f9-8801-ed372754466a admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.625985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7d8a-d26f-49f9-8801-ed372754466a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.626272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7d8a-d26f-49f9-8801-ed372754466a admin admin] PATH_INFO: `/v3/projects/abb83ff8068c419782be144cf9428242/users/681eb2876dca4ee7be76a02dbc6651a8/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.628800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c7d8a-d26f-49f9-8801-ed372754466a admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb83ff8068c419782be144cf9428242, user_id=681eb2876dca4ee7be76a02dbc6651a8, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:28.629122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47e381-47d2-4a4d-ad06-fb9e16fb2ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:28.629869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e381-47d2-4a4d-ad06-fb9e16fb2ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.630226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e381-47d2-4a4d-ad06-fb9e16fb2ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.630579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e381-47d2-4a4d-ad06-fb9e16fb2ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.631641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c7d8a-d26f-49f9-8801-ed372754466a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:28.644707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47e381-47d2-4a4d-ad06-fb9e16fb2ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:28.646383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47e381-47d2-4a4d-ad06-fb9e16fb2ec2 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:28.649875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1070/2116] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:28 2022] PUT /identity/v3/projects/abb83ff8068c419782be144cf9428242/users/681eb2876dca4ee7be76a02dbc6651a8/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:28.659159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee14b-a49d-41be-8ac1-5758f267e40e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.659459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee14b-a49d-41be-8ac1-5758f267e40e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.659772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee14b-a49d-41be-8ac1-5758f267e40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.663885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1047/2117] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:28.692040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c0bee14b-a49d-41be-8ac1-5758f267e40e None None] MFA Rules not processed for user `681eb2876dca4ee7be76a02dbc6651a8`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:28.701426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c0bee14b-a49d-41be-8ac1-5758f267e40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:28.773715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1071/2118] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:28.785982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47e381-47d2-4a4d-ad06-fb9e16fb2ec2 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:28.787572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8f47e381-47d2-4a4d-ad06-fb9e16fb2ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:28.848547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47e381-47d2-4a4d-ad06-fb9e16fb2ec2 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:28.904390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc97a1-9fdc-42ee-954d-e2debda07439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:28.905052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc97a1-9fdc-42ee-954d-e2debda07439 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:28.905392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc97a1-9fdc-42ee-954d-e2debda07439 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:28.905681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc97a1-9fdc-42ee-954d-e2debda07439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:28.915306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc97a1-9fdc-42ee-954d-e2debda07439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:28.916817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc97a1-9fdc-42ee-954d-e2debda07439 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:28.926504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1048/2119] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:29.131243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee14b-a49d-41be-8ac1-5758f267e40e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:29.143227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee14b-a49d-41be-8ac1-5758f267e40e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:29.147383 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13229e28-f9e2-4478-8757-79482d54aec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:29.148140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13229e28-f9e2-4478-8757-79482d54aec4 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:29.148458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13229e28-f9e2-4478-8757-79482d54aec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:29.148916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13229e28-f9e2-4478-8757-79482d54aec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:29.150917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-13229e28-f9e2-4478-8757-79482d54aec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:29.235778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13229e28-f9e2-4478-8757-79482d54aec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:29.238565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13229e28-f9e2-4478-8757-79482d54aec4 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:29.271701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1072/2120] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:29.359708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc97a1-9fdc-42ee-954d-e2debda07439 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:29.361245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-92fc97a1-9fdc-42ee-954d-e2debda07439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:29.376246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:29.447158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc97a1-9fdc-42ee-954d-e2debda07439 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:29.459997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:29.461352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:29.463469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:29.463772 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] PATH_INFO: `/v3/projects/aaa1c6b8f80d4df3a0b4b321bba9d790` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:29.465360 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa1c6b8f80d4df3a0b4b321bba9d790)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:29.467476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:29.605913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa1c6b8f80d4df3a0b4b321bba9d790', 'request_id': 'req-db67f565-65ab-4a48-859e-1b4c4c5ccaab'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:29.612200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa1c6b8f80d4df3a0b4b321bba9d790', 'request_id': 'req-db67f565-65ab-4a48-859e-1b4c4c5ccaab'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:29.639202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:29.678475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa1c6b8f80d4df3a0b4b321bba9d790', 'request_id': 'req-db67f565-65ab-4a48-859e-1b4c4c5ccaab'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:29.690373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] The token cache is being invalidate because project aaa1c6b8f80d4df3a0b4b321bba9d790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:29.690667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:29.696132 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:29.696132 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1049/2121] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:29 2022] DELETE /identity/v3/projects/aaa1c6b8f80d4df3a0b4b321bba9d790 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:29.697048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13229e28-f9e2-4478-8757-79482d54aec4 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:29.708514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13229e28-f9e2-4478-8757-79482d54aec4 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:29.771604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:29.772741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:29.773001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:29.773277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] PATH_INFO: `/v3/users/afc46c62718147f6b09b9188907a9c7e` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:29.774466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc46c62718147f6b09b9188907a9c7e)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:29.776973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:30.042215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc46c62718147f6b09b9188907a9c7e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:30.042215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc46c62718147f6b09b9188907a9c7e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:30.045923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc46c62718147f6b09b9188907a9c7e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:30.170405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc46c62718147f6b09b9188907a9c7e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:30.184186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc46c62718147f6b09b9188907a9c7e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:30.190566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1073/2122] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:29 2022] DELETE /identity/v3/users/afc46c62718147f6b09b9188907a9c7e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:30.456580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:30.697902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:30.708599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:30.712322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67f565-65ab-4a48-859e-1b4c4c5ccaab admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:30.773139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:30.773994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:30.774269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:30.774542 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] PATH_INFO: `/v3/projects/fbce6b42da624e65930ed3df733b4ce2` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:30.775708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbce6b42da624e65930ed3df733b4ce2)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:30.777629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:30.891483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbce6b42da624e65930ed3df733b4ce2', 'request_id': 'req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:30.902996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbce6b42da624e65930ed3df733b4ce2', 'request_id': 'req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:30.934670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:30.936043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:30.949018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01edb8c-1711-4f4f-ace0-f1ea8bc6ff20 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:31.004591 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:31.005489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.005768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.006091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] PATH_INFO: `/v3/users/afdf2431fde34abeb482d07c726ad62a` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.007268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdf2431fde34abeb482d07c726ad62a)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:31.009479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:31.019592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbce6b42da624e65930ed3df733b4ce2', 'request_id': 'req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:31.033127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] The token cache is being invalidate because project fbce6b42da624e65930ed3df733b4ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:31.033423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:31.034127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea1a4bdd-3335-480c-a11b-11f2fc5835dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:31.035684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1050/2123] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:30 2022] DELETE /identity/v3/projects/fbce6b42da624e65930ed3df733b4ce2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:31.040587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2489a0e-dfdb-4a55-a534-344273b0b6fc None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.040883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2489a0e-dfdb-4a55-a534-344273b0b6fc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.041212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2489a0e-dfdb-4a55-a534-344273b0b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.060414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d2489a0e-dfdb-4a55-a534-344273b0b6fc None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:31.062539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d2489a0e-dfdb-4a55-a534-344273b0b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:31.075423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1051/2124] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:31.078356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73681-e57e-4d5f-8ee2-149f5d49c06d None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.078648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73681-e57e-4d5f-8ee2-149f5d49c06d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.078925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73681-e57e-4d5f-8ee2-149f5d49c06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.098285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-a4b73681-e57e-4d5f-8ee2-149f5d49c06d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:31.099567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a4b73681-e57e-4d5f-8ee2-149f5d49c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:31.111784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1052/2125] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:31.118499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b73681-e57e-4d5f-8ee2-149f5d49c06d None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:31.126479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b73681-e57e-4d5f-8ee2-149f5d49c06d None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:31.131881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27cecc-441f-4c50-b850-a1f6c5a07b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:31.133273 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27cecc-441f-4c50-b850-a1f6c5a07b0d admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.133775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27cecc-441f-4c50-b850-a1f6c5a07b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.134245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27cecc-441f-4c50-b850-a1f6c5a07b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.135162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27cecc-441f-4c50-b850-a1f6c5a07b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:31.136191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27cecc-441f-4c50-b850-a1f6c5a07b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:31.148799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27cecc-441f-4c50-b850-a1f6c5a07b0d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:31.150856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1053/2126] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:41:31.163380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27cecc-441f-4c50-b850-a1f6c5a07b0d admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:31.175111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27cecc-441f-4c50-b850-a1f6c5a07b0d admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:31.181361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03ee7f-1389-4f09-977d-74c88b111071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:31.181361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03ee7f-1389-4f09-977d-74c88b111071 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.181361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03ee7f-1389-4f09-977d-74c88b111071 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.181361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03ee7f-1389-4f09-977d-74c88b111071 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.181797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03ee7f-1389-4f09-977d-74c88b111071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:31.183804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03ee7f-1389-4f09-977d-74c88b111071 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:31.270325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdf2431fde34abeb482d07c726ad62a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:31.271055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdf2431fde34abeb482d07c726ad62a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:31.278496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdf2431fde34abeb482d07c726ad62a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:31.319825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1054/2127] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:31 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:31.324378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03ee7f-1389-4f09-977d-74c88b111071 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:31.383200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03ee7f-1389-4f09-977d-74c88b111071 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:31.388073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdf2431fde34abeb482d07c726ad62a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:31.389001 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ef348-8d09-46a7-9f86-60fd92672474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:31.389667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ef348-8d09-46a7-9f86-60fd92672474 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.389950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ef348-8d09-46a7-9f86-60fd92672474 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.390227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ef348-8d09-46a7-9f86-60fd92672474 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.391388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ef348-8d09-46a7-9f86-60fd92672474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:31.392870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ef348-8d09-46a7-9f86-60fd92672474 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:31.402900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d0563afb-f507-48f0-8b2f-9ac89529b5f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdf2431fde34abeb482d07c726ad62a'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:31.409391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1074/2128] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:30 2022] DELETE /identity/v3/users/afdf2431fde34abeb482d07c726ad62a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:31.414137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac041ec-9f9d-40ab-a5d8-d66dc5a393b0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.414423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac041ec-9f9d-40ab-a5d8-d66dc5a393b0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.414706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac041ec-9f9d-40ab-a5d8-d66dc5a393b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.431190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-0ac041ec-9f9d-40ab-a5d8-d66dc5a393b0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:31.432927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0ac041ec-9f9d-40ab-a5d8-d66dc5a393b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:31.495386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1075/2129] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:31.499777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1055/2130] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:31 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:31.503040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac041ec-9f9d-40ab-a5d8-d66dc5a393b0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:31.504798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0ac041ec-9f9d-40ab-a5d8-d66dc5a393b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:31.506026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ef348-8d09-46a7-9f86-60fd92672474 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:31.509158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d55ef348-8d09-46a7-9f86-60fd92672474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:31.519024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac041ec-9f9d-40ab-a5d8-d66dc5a393b0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:31.525173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d204a-9051-4004-a766-e51dc941c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:31.525844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d204a-9051-4004-a766-e51dc941c2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.526163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d204a-9051-4004-a766-e51dc941c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.526615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d204a-9051-4004-a766-e51dc941c2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.527503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d204a-9051-4004-a766-e51dc941c2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:31.530286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d204a-9051-4004-a766-e51dc941c2b2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:31.542001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1076/2131] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:31.549121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d204a-9051-4004-a766-e51dc941c2b2 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:31.561835 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d204a-9051-4004-a766-e51dc941c2b2 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:31.567572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a1acb-9e84-4c96-850c-4db0bef7c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:31.568617 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a1acb-9e84-4c96-850c-4db0bef7c6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.569254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a1acb-9e84-4c96-850c-4db0bef7c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.569903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a1acb-9e84-4c96-850c-4db0bef7c6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.570784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a1acb-9e84-4c96-850c-4db0bef7c6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:31.572602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a1acb-9e84-4c96-850c-4db0bef7c6e7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:31.577846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ef348-8d09-46a7-9f86-60fd92672474 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:31.589497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1077/2132] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:31.591092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a1acb-9e84-4c96-850c-4db0bef7c6e7 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:31.612423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a1acb-9e84-4c96-850c-4db0bef7c6e7 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:31.625770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2732c-49fb-4a3b-9dcd-4b20fce27e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:31.626740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2732c-49fb-4a3b-9dcd-4b20fce27e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.627126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2732c-49fb-4a3b-9dcd-4b20fce27e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.628072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2732c-49fb-4a3b-9dcd-4b20fce27e92 admin admin] PATH_INFO: `/v3/projects/2bd24dc946e54e94a2d52aa02e94de80/users/609c6123ab01432ab964c97ed0503b1a/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.649958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2732c-49fb-4a3b-9dcd-4b20fce27e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd24dc946e54e94a2d52aa02e94de80, user_id=609c6123ab01432ab964c97ed0503b1a, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:31.653863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2732c-49fb-4a3b-9dcd-4b20fce27e92 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:31.663278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c94be-09db-424b-98f9-f0f065aca7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:31.664228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c94be-09db-424b-98f9-f0f065aca7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.664585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c94be-09db-424b-98f9-f0f065aca7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.664929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c94be-09db-424b-98f9-f0f065aca7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.678240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c94be-09db-424b-98f9-f0f065aca7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:31.680347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c94be-09db-424b-98f9-f0f065aca7e9 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:31.697691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1056/2133] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:31.774686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1078/2134] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:31 2022] PUT /identity/v3/projects/2bd24dc946e54e94a2d52aa02e94de80/users/609c6123ab01432ab964c97ed0503b1a/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:31.786629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266702-be02-42a7-8b55-4120ff6f14d8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:31.787122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266702-be02-42a7-8b55-4120ff6f14d8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:31.787468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266702-be02-42a7-8b55-4120ff6f14d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:31.825461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8b266702-be02-42a7-8b55-4120ff6f14d8 None None] MFA Rules not processed for user `609c6123ab01432ab964c97ed0503b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:31.826676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8b266702-be02-42a7-8b55-4120ff6f14d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:31.888452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1057/2135] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:31.892854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2732c-49fb-4a3b-9dcd-4b20fce27e92 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:32.001262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2732c-49fb-4a3b-9dcd-4b20fce27e92 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:32.006743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8cc13-3f46-43e2-8e96-b78a88cc1b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:32.007406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8cc13-3f46-43e2-8e96-b78a88cc1b94 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:32.007695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8cc13-3f46-43e2-8e96-b78a88cc1b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:32.007999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8cc13-3f46-43e2-8e96-b78a88cc1b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:32.008724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8cc13-3f46-43e2-8e96-b78a88cc1b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:32.011344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8cc13-3f46-43e2-8e96-b78a88cc1b94 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:32.187310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1079/2136] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:31 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:32.191797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b266702-be02-42a7-8b55-4120ff6f14d8 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:32.203504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b266702-be02-42a7-8b55-4120ff6f14d8 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:32.239847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8cc13-3f46-43e2-8e96-b78a88cc1b94 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:32.241667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-29b8cc13-3f46-43e2-8e96-b78a88cc1b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:32.270748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1900a-11c6-4bc1-a22f-e4aacdc8d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:32.270748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1900a-11c6-4bc1-a22f-e4aacdc8d7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:32.270748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1900a-11c6-4bc1-a22f-e4aacdc8d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:32.271323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1900a-11c6-4bc1-a22f-e4aacdc8d7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:32.271841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1900a-11c6-4bc1-a22f-e4aacdc8d7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:32.273848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1900a-11c6-4bc1-a22f-e4aacdc8d7c7 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:32.316486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8cc13-3f46-43e2-8e96-b78a88cc1b94 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:32.321095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:32.321949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:32.322238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:32.322519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] PATH_INFO: `/v3/projects/1a369ad136184bc194d49eeef61e2b63` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:32.324541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a369ad136184bc194d49eeef61e2b63)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:32.326774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:32.382059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:32.391116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1058/2137] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:32 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:32.395516 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1900a-11c6-4bc1-a22f-e4aacdc8d7c7 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:32.406341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1900a-11c6-4bc1-a22f-e4aacdc8d7c7 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:32.411974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018dc15-6a9d-4578-9bb5-fd1a2a3003c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:32.412867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018dc15-6a9d-4578-9bb5-fd1a2a3003c8 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:32.413147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018dc15-6a9d-4578-9bb5-fd1a2a3003c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:32.413427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018dc15-6a9d-4578-9bb5-fd1a2a3003c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:32.414169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018dc15-6a9d-4578-9bb5-fd1a2a3003c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:32.415886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018dc15-6a9d-4578-9bb5-fd1a2a3003c8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:32.436620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1059/2138] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:32.437715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018dc15-6a9d-4578-9bb5-fd1a2a3003c8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:32.441076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a369ad136184bc194d49eeef61e2b63', 'request_id': 'req-ac14cb7f-45d3-447c-abf1-4039c06faa78'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.446401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a369ad136184bc194d49eeef61e2b63', 'request_id': 'req-ac14cb7f-45d3-447c-abf1-4039c06faa78'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.447162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018dc15-6a9d-4578-9bb5-fd1a2a3003c8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:32.453016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a369ad136184bc194d49eeef61e2b63', 'request_id': 'req-ac14cb7f-45d3-447c-abf1-4039c06faa78'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.505001 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eb202-6e90-45cf-b556-9f8c256b16d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:32.505891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eb202-6e90-45cf-b556-9f8c256b16d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:32.506176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eb202-6e90-45cf-b556-9f8c256b16d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:32.506458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eb202-6e90-45cf-b556-9f8c256b16d4 admin admin] PATH_INFO: `/v3/projects/ee5fe2e539fc4f34b509f05b17f52ab4/users/7b6b1780652c4f808c7f83b793da90ef/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:32.522649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8eb202-6e90-45cf-b556-9f8c256b16d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5fe2e539fc4f34b509f05b17f52ab4, user_id=7b6b1780652c4f808c7f83b793da90ef, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:32.525383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8eb202-6e90-45cf-b556-9f8c256b16d4 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:32.530394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] The token cache is being invalidate because project 1a369ad136184bc194d49eeef61e2b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:32.537691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.537691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.537691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1080/2139] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:32 2022] DELETE /identity/v3/projects/1a369ad136184bc194d49eeef61e2b63 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:32.537691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:32.538166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:32.550981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14cb7f-45d3-447c-abf1-4039c06faa78 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:32.556190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:32.557281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:32.557563 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:32.557843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] PATH_INFO: `/v3/users/33cf07e5e6fc499dbda2f3a8851ec45d` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:32.559102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cf07e5e6fc499dbda2f3a8851ec45d)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:32.561938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:32.622784 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1060/2140] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:32 2022] PUT /identity/v3/projects/ee5fe2e539fc4f34b509f05b17f52ab4/users/7b6b1780652c4f808c7f83b793da90ef/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:32.632013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eb202-6e90-45cf-b556-9f8c256b16d4 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:32.632013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9f8eb202-6e90-45cf-b556-9f8c256b16d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:32.697411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eb202-6e90-45cf-b556-9f8c256b16d4 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:32.703893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d61c-0b69-4944-b017-3a1add0fcbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:32.704640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d61c-0b69-4944-b017-3a1add0fcbbf admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:32.704935 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d61c-0b69-4944-b017-3a1add0fcbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:32.705218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d61c-0b69-4944-b017-3a1add0fcbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:32.705974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41d61c-0b69-4944-b017-3a1add0fcbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:32.707818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41d61c-0b69-4944-b017-3a1add0fcbbf admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:32.719846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1061/2141] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:32.723353 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d61c-0b69-4944-b017-3a1add0fcbbf admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:32.735877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d61c-0b69-4944-b017-3a1add0fcbbf admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:32.741652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dec3f-f9cf-42c5-86a4-06f7ea3dfae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:32.742555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dec3f-f9cf-42c5-86a4-06f7ea3dfae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:32.742866 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dec3f-f9cf-42c5-86a4-06f7ea3dfae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:32.743148 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dec3f-f9cf-42c5-86a4-06f7ea3dfae0 admin admin] PATH_INFO: `/v3/projects/ee5fe2e539fc4f34b509f05b17f52ab4/users/7b6b1780652c4f808c7f83b793da90ef/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:32.745911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dec3f-f9cf-42c5-86a4-06f7ea3dfae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5fe2e539fc4f34b509f05b17f52ab4, user_id=7b6b1780652c4f808c7f83b793da90ef, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:32.748900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dec3f-f9cf-42c5-86a4-06f7ea3dfae0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:32.760746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1062/2142] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:32 2022] PUT /identity/v3/projects/ee5fe2e539fc4f34b509f05b17f52ab4/users/7b6b1780652c4f808c7f83b793da90ef/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:32.770724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378d9cc-91af-49e2-a1fb-675f1adba94f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:32.771016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378d9cc-91af-49e2-a1fb-675f1adba94f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:32.771292 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378d9cc-91af-49e2-a1fb-675f1adba94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:32.775520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cf07e5e6fc499dbda2f3a8851ec45d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.777538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cf07e5e6fc499dbda2f3a8851ec45d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.787994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cf07e5e6fc499dbda2f3a8851ec45d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.805489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d378d9cc-91af-49e2-a1fb-675f1adba94f None None] MFA Rules not processed for user `7b6b1780652c4f808c7f83b793da90ef`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:32.806713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d378d9cc-91af-49e2-a1fb-675f1adba94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:32.879507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1063/2143] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:32.891081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:32.892750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378d9cc-91af-49e2-a1fb-675f1adba94f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:32.897773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cf07e5e6fc499dbda2f3a8851ec45d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.897894 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d378d9cc-91af-49e2-a1fb-675f1adba94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:32.911039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cf07e5e6fc499dbda2f3a8851ec45d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:32.924888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1081/2144] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:32 2022] DELETE /identity/v3/users/33cf07e5e6fc499dbda2f3a8851ec45d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:32.977527 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378d9cc-91af-49e2-a1fb-675f1adba94f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:33.020138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:33.021293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:33.039884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:33.040795 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:33.041180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:33.042176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:33.046955 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:33.119983 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:33.121559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:33.130435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b7b9-ed8e-4a71-9db5-072a130d5552 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:33.130435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:33.130435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:33.130435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:33.130917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] PATH_INFO: `/v3/users/32ebc6c6fe724d7083614d7f5fd38b50` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:33.131765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ebc6c6fe724d7083614d7f5fd38b50)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:33.133465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:33.133598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1064/2145] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:33.349724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ebc6c6fe724d7083614d7f5fd38b50'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.350387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ebc6c6fe724d7083614d7f5fd38b50'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.357549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ebc6c6fe724d7083614d7f5fd38b50'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.435037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:33.436901 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:33.451976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0920ff-fe17-4390-9378-33a26b2885fc service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:33.456283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ebc6c6fe724d7083614d7f5fd38b50'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.472421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:33.472695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a824e48a-90e6-431e-acb9-c9fb7e3a95e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ebc6c6fe724d7083614d7f5fd38b50'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.473506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:33.473796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:33.474078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] PATH_INFO: `/v3/projects/0b8e190d0b0c4fdcabec7d6d495afc5b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:33.475823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8e190d0b0c4fdcabec7d6d495afc5b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:33.478028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:33.482757 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1082/2146] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:33 2022] DELETE /identity/v3/users/32ebc6c6fe724d7083614d7f5fd38b50 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:33.484476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a1b9-ec92-4a65-8e31-e188dcc46de5 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:33.484770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a1b9-ec92-4a65-8e31-e188dcc46de5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:33.485082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a1b9-ec92-4a65-8e31-e188dcc46de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:33.504089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-3fe2a1b9-ec92-4a65-8e31-e188dcc46de5 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:33.505513 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3fe2a1b9-ec92-4a65-8e31-e188dcc46de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:33.571933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1083/2147] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:33.578809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2a1b9-ec92-4a65-8e31-e188dcc46de5 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:33.580457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3fe2a1b9-ec92-4a65-8e31-e188dcc46de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:33.613015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8e190d0b0c4fdcabec7d6d495afc5b', 'request_id': 'req-e245c657-d8cb-4857-8be8-2e74d1ce1bed'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.620431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8e190d0b0c4fdcabec7d6d495afc5b', 'request_id': 'req-e245c657-d8cb-4857-8be8-2e74d1ce1bed'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.647716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2a1b9-ec92-4a65-8e31-e188dcc46de5 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:33.693696 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eec9f-fa5b-4b8a-83bb-725ec614fbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:33.694594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eec9f-fa5b-4b8a-83bb-725ec614fbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:33.694875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eec9f-fa5b-4b8a-83bb-725ec614fbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:33.695152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eec9f-fa5b-4b8a-83bb-725ec614fbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:33.765298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39eec9f-fa5b-4b8a-83bb-725ec614fbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:33.766756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39eec9f-fa5b-4b8a-83bb-725ec614fbe6 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:33.770180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8e190d0b0c4fdcabec7d6d495afc5b', 'request_id': 'req-e245c657-d8cb-4857-8be8-2e74d1ce1bed'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.776823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1084/2148] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:33.778693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eec9f-fa5b-4b8a-83bb-725ec614fbe6 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:33.780216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c39eec9f-fa5b-4b8a-83bb-725ec614fbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:33.782569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] The token cache is being invalidate because project 0b8e190d0b0c4fdcabec7d6d495afc5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:33.782866 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.783507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:33.785248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1065/2149] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:33 2022] DELETE /identity/v3/projects/0b8e190d0b0c4fdcabec7d6d495afc5b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:33.789101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:33.791350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:33.794139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eec9f-fa5b-4b8a-83bb-725ec614fbe6 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:33.799707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:33.802736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:33.802736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:33.802736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] PATH_INFO: `/v3/users/9e187e19fd214d9d88b61d23c69c4474` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:33.802736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e187e19fd214d9d88b61d23c69c4474)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:33.804021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:33.806405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c657-d8cb-4857-8be8-2e74d1ce1bed admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:33.812048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:33.813144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:33.813495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:33.813845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] PATH_INFO: `/v3/users/b98a4a919d5f4d1dbb20167a4ea713f8` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:33.815218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98a4a919d5f4d1dbb20167a4ea713f8)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:33.817295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:34.111856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98a4a919d5f4d1dbb20167a4ea713f8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.112930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98a4a919d5f4d1dbb20167a4ea713f8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.115095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e187e19fd214d9d88b61d23c69c4474'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.117948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e187e19fd214d9d88b61d23c69c4474'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.131809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e187e19fd214d9d88b61d23c69c4474'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.221912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98a4a919d5f4d1dbb20167a4ea713f8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.230384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98a4a919d5f4d1dbb20167a4ea713f8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.243598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98a4a919d5f4d1dbb20167a4ea713f8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.250656 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1066/2150] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:33 2022] DELETE /identity/v3/users/b98a4a919d5f4d1dbb20167a4ea713f8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:34.305441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e187e19fd214d9d88b61d23c69c4474'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.313862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:34.318316 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:34.335928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0c48cf3e-dab8-418b-a700-f252fb54c323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e187e19fd214d9d88b61d23c69c4474'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.351352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1085/2151] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:33 2022] DELETE /identity/v3/users/9e187e19fd214d9d88b61d23c69c4474 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:34.355126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aa656-0715-464f-ab70-df3e85b9f464 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:34.355440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aa656-0715-464f-ab70-df3e85b9f464 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:34.355878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aa656-0715-464f-ab70-df3e85b9f464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:34.379860 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-881aa656-0715-464f-ab70-df3e85b9f464 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:34.381461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-881aa656-0715-464f-ab70-df3e85b9f464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:34.408592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd300910-2b59-4a12-adf6-6ec012e3876d admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:34.459154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1086/2152] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:34.474711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:34.475596 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:34.476282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:34.476282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] PATH_INFO: `/v3/users/609c6123ab01432ab964c97ed0503b1a` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:34.477567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609c6123ab01432ab964c97ed0503b1a)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:34.480118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:34.483846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aa656-0715-464f-ab70-df3e85b9f464 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:34.485429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-881aa656-0715-464f-ab70-df3e85b9f464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:34.552893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aa656-0715-464f-ab70-df3e85b9f464 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:34.556508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb852d-68da-4655-aff1-3e0fcf557897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:34.557191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb852d-68da-4655-aff1-3e0fcf557897 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:34.557474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb852d-68da-4655-aff1-3e0fcf557897 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:34.557749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb852d-68da-4655-aff1-3e0fcf557897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:34.567240 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb852d-68da-4655-aff1-3e0fcf557897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:34.568981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb852d-68da-4655-aff1-3e0fcf557897 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:34.578324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1087/2153] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:34.657356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb852d-68da-4655-aff1-3e0fcf557897 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:34.658888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-6edb852d-68da-4655-aff1-3e0fcf557897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:34.672178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb852d-68da-4655-aff1-3e0fcf557897 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:34.676884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:34.677741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:34.678026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:34.683554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] PATH_INFO: `/v3/projects/1734bf351b1a4f6b9429ca9d9bd18a40` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:34.683554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1734bf351b1a4f6b9429ca9d9bd18a40)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:34.683554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:34.887436 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:34.900006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609c6123ab01432ab964c97ed0503b1a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.900696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609c6123ab01432ab964c97ed0503b1a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.910631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1734bf351b1a4f6b9429ca9d9bd18a40', 'request_id': 'req-093ad1b5-d8ee-4841-9127-413ea32d3416'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.916102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1734bf351b1a4f6b9429ca9d9bd18a40', 'request_id': 'req-093ad1b5-d8ee-4841-9127-413ea32d3416'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.922435 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1734bf351b1a4f6b9429ca9d9bd18a40', 'request_id': 'req-093ad1b5-d8ee-4841-9127-413ea32d3416'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.977180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609c6123ab01432ab964c97ed0503b1a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.985181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609c6123ab01432ab964c97ed0503b1a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:34.998383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609c6123ab01432ab964c97ed0503b1a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.005495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1067/2154] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:34 2022] DELETE /identity/v3/users/609c6123ab01432ab964c97ed0503b1a => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:35.006429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:35.009551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:35.039047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] The token cache is being invalidate because project 1734bf351b1a4f6b9429ca9d9bd18a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:35.039476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.040152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-093ad1b5-d8ee-4841-9127-413ea32d3416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.055776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1088/2155] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:34 2022] DELETE /identity/v3/projects/1734bf351b1a4f6b9429ca9d9bd18a40 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:35.055776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc4c5-d16e-493c-aed0-8e443142e4a3 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.055776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc4c5-d16e-493c-aed0-8e443142e4a3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.055776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc4c5-d16e-493c-aed0-8e443142e4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.075761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-8b9fc4c5-d16e-493c-aed0-8e443142e4a3 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:35.075761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8b9fc4c5-d16e-493c-aed0-8e443142e4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:35.093943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a1786-c935-4202-b8d8-275c12ebe773 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:35.099930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:35.101119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.101614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.102082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] PATH_INFO: `/v3/projects/591c529065aa4a9496c43fbb8c2a9df8` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.103559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591c529065aa4a9496c43fbb8c2a9df8)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:35.105927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:35.152554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1089/2156] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:35.159506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fc4c5-d16e-493c-aed0-8e443142e4a3 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:35.161236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8b9fc4c5-d16e-493c-aed0-8e443142e4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:35.241857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fc4c5-d16e-493c-aed0-8e443142e4a3 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:35.246566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1cf76-80ea-498a-a19c-794d931e22bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:35.247221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1cf76-80ea-498a-a19c-794d931e22bb service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.247503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1cf76-80ea-498a-a19c-794d931e22bb service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.247806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1cf76-80ea-498a-a19c-794d931e22bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.257312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1cf76-80ea-498a-a19c-794d931e22bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:35.258753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1cf76-80ea-498a-a19c-794d931e22bb service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:35.269524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1090/2157] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:35.294844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591c529065aa4a9496c43fbb8c2a9df8', 'request_id': 'req-81690fc5-3c05-43e9-8009-9373fcb98681'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.301935 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591c529065aa4a9496c43fbb8c2a9df8', 'request_id': 'req-81690fc5-3c05-43e9-8009-9373fcb98681'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.315654 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1cf76-80ea-498a-a19c-794d931e22bb service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:35.317150 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1cc1cf76-80ea-498a-a19c-794d931e22bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:35.331323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1cf76-80ea-498a-a19c-794d931e22bb service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:35.387768 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:35.399953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:35.400909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.401350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.401700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] PATH_INFO: `/v3/projects/7da8d2ef26e54cfea175cf8dcc6a327f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.402972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da8d2ef26e54cfea175cf8dcc6a327f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:35.405062 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:35.444405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591c529065aa4a9496c43fbb8c2a9df8', 'request_id': 'req-81690fc5-3c05-43e9-8009-9373fcb98681'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.458047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] The token cache is being invalidate because project 591c529065aa4a9496c43fbb8c2a9df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:35.458047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.458047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-81690fc5-3c05-43e9-8009-9373fcb98681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.462580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1068/2158] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:35 2022] DELETE /identity/v3/projects/591c529065aa4a9496c43fbb8c2a9df8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:35.463848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9788076-b0ea-46b4-88bb-9b85b271425e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.464138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9788076-b0ea-46b4-88bb-9b85b271425e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.464418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9788076-b0ea-46b4-88bb-9b85b271425e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.482982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b9788076-b0ea-46b4-88bb-9b85b271425e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:35.484245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b9788076-b0ea-46b4-88bb-9b85b271425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:35.500106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1069/2159] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:35.501582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eab02-e24a-4e72-a2f1-c987ee13fbb6 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.501874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eab02-e24a-4e72-a2f1-c987ee13fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.502153 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eab02-e24a-4e72-a2f1-c987ee13fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.521947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-823eab02-e24a-4e72-a2f1-c987ee13fbb6 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:35.523432 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-823eab02-e24a-4e72-a2f1-c987ee13fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:35.538573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1070/2160] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:35.539467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eab02-e24a-4e72-a2f1-c987ee13fbb6 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:35.549982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eab02-e24a-4e72-a2f1-c987ee13fbb6 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:35.555400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4b21-9918-41af-a4b5-d86fe8cf7c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:35.566864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4b21-9918-41af-a4b5-d86fe8cf7c7d admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.566864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4b21-9918-41af-a4b5-d86fe8cf7c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.566864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4b21-9918-41af-a4b5-d86fe8cf7c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.566864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4b21-9918-41af-a4b5-d86fe8cf7c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:35.566864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4b21-9918-41af-a4b5-d86fe8cf7c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:35.566864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4b21-9918-41af-a4b5-d86fe8cf7c7d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:35.578825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da8d2ef26e54cfea175cf8dcc6a327f', 'request_id': 'req-c1f47a01-b50b-49a4-8338-057cf474f466'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.579355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1071/2161] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:35.580742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4b21-9918-41af-a4b5-d86fe8cf7c7d admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:35.588629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da8d2ef26e54cfea175cf8dcc6a327f', 'request_id': 'req-c1f47a01-b50b-49a4-8338-057cf474f466'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.593238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4b21-9918-41af-a4b5-d86fe8cf7c7d admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:35.607247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da8d2ef26e54cfea175cf8dcc6a327f', 'request_id': 'req-c1f47a01-b50b-49a4-8338-057cf474f466'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.657778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804f975-fddf-4175-bff0-37701ff32baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:35.658304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804f975-fddf-4175-bff0-37701ff32baa admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.658594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804f975-fddf-4175-bff0-37701ff32baa admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.658893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804f975-fddf-4175-bff0-37701ff32baa admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.659685 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804f975-fddf-4175-bff0-37701ff32baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:35.661626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804f975-fddf-4175-bff0-37701ff32baa admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:35.729907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] The token cache is being invalidate because project 7da8d2ef26e54cfea175cf8dcc6a327f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:35.730286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.731023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.732946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1091/2162] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:35 2022] DELETE /identity/v3/projects/7da8d2ef26e54cfea175cf8dcc6a327f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:35.736583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:35.737923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:35.750728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f47a01-b50b-49a4-8338-057cf474f466 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:35.755522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:35.756412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.756701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.756982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] PATH_INFO: `/v3/users/bc5326e06953464884173a0adc0adc5e` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.758194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5326e06953464884173a0adc0adc5e)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:35.760169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:35.843711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1072/2163] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:35 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:35.843711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804f975-fddf-4175-bff0-37701ff32baa admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:35.845116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4804f975-fddf-4175-bff0-37701ff32baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:35.907682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804f975-fddf-4175-bff0-37701ff32baa admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:35.912314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:35.913193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:35.913474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:35.913749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] PATH_INFO: `/v3/projects/2bd24dc946e54e94a2d52aa02e94de80` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:35.914938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd24dc946e54e94a2d52aa02e94de80)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:35.917550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:35.961392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5326e06953464884173a0adc0adc5e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.962060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5326e06953464884173a0adc0adc5e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:35.969039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5326e06953464884173a0adc0adc5e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.014917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd24dc946e54e94a2d52aa02e94de80', 'request_id': 'req-ccac4481-0ab7-4969-9750-0a131db0bc2b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.021334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5326e06953464884173a0adc0adc5e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.021499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd24dc946e54e94a2d52aa02e94de80', 'request_id': 'req-ccac4481-0ab7-4969-9750-0a131db0bc2b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.039310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5326e06953464884173a0adc0adc5e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.044680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1092/2164] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:35 2022] DELETE /identity/v3/users/bc5326e06953464884173a0adc0adc5e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:36.048276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:36.049795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:36.118493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e3334-1de4-435a-82d8-9a5a2ce6e4cc admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:36.124418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd24dc946e54e94a2d52aa02e94de80', 'request_id': 'req-ccac4481-0ab7-4969-9750-0a131db0bc2b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.128926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72637f3b-a89e-48f8-afc8-5830d325d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:36.133421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72637f3b-a89e-48f8-afc8-5830d325d45e admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:36.133421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72637f3b-a89e-48f8-afc8-5830d325d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:36.133421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72637f3b-a89e-48f8-afc8-5830d325d45e admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:36.133421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72637f3b-a89e-48f8-afc8-5830d325d45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:36.136278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72637f3b-a89e-48f8-afc8-5830d325d45e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:36.142842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] The token cache is being invalidate because project 2bd24dc946e54e94a2d52aa02e94de80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:36.143254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.144601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.146390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1073/2165] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:35 2022] DELETE /identity/v3/projects/2bd24dc946e54e94a2d52aa02e94de80 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:36.150762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:36.152648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:36.217760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac4481-0ab7-4969-9750-0a131db0bc2b admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:36.222716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:36.223697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:36.223907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:36.224155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] PATH_INFO: `/v3/users/7b6b1780652c4f808c7f83b793da90ef` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:36.225409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6b1780652c4f808c7f83b793da90ef)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:36.227887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:36.259543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1093/2166] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:36 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:36.260759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72637f3b-a89e-48f8-afc8-5830d325d45e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:36.262844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-72637f3b-a89e-48f8-afc8-5830d325d45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:36.277434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72637f3b-a89e-48f8-afc8-5830d325d45e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:36.282708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c990-519c-44f7-be6c-cf022535b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:36.283401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c990-519c-44f7-be6c-cf022535b9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:36.283685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c990-519c-44f7-be6c-cf022535b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:36.286575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c990-519c-44f7-be6c-cf022535b9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:36.286575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958c990-519c-44f7-be6c-cf022535b9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:36.286575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958c990-519c-44f7-be6c-cf022535b9a9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:36.298193 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1094/2167] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:36.301509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c990-519c-44f7-be6c-cf022535b9a9 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:36.315353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c990-519c-44f7-be6c-cf022535b9a9 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:36.319503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6cd73-b9f7-4019-bc8e-4bbb18145ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:36.320225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6cd73-b9f7-4019-bc8e-4bbb18145ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:36.320506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6cd73-b9f7-4019-bc8e-4bbb18145ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:36.320782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6cd73-b9f7-4019-bc8e-4bbb18145ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:36.321520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6cd73-b9f7-4019-bc8e-4bbb18145ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:36.323329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6cd73-b9f7-4019-bc8e-4bbb18145ad9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:36.334697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1095/2168] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:36.338424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6cd73-b9f7-4019-bc8e-4bbb18145ad9 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:36.348234 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6cd73-b9f7-4019-bc8e-4bbb18145ad9 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:36.353011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396ffb5-e0fe-43d9-8831-ce8bcf134c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:36.354036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396ffb5-e0fe-43d9-8831-ce8bcf134c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:36.354870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396ffb5-e0fe-43d9-8831-ce8bcf134c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:36.355209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396ffb5-e0fe-43d9-8831-ce8bcf134c2a admin admin] PATH_INFO: `/v3/projects/d7cd05ee74fc42dfa27d0c50c0aa76ba/users/88792f6a06aa46dbaffd23048cdb7b15/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:36.377421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396ffb5-e0fe-43d9-8831-ce8bcf134c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7cd05ee74fc42dfa27d0c50c0aa76ba, user_id=88792f6a06aa46dbaffd23048cdb7b15, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:36.380567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396ffb5-e0fe-43d9-8831-ce8bcf134c2a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:36.462093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6b1780652c4f808c7f83b793da90ef'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.462707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6b1780652c4f808c7f83b793da90ef'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.494367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1096/2169] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:36 2022] PUT /identity/v3/projects/d7cd05ee74fc42dfa27d0c50c0aa76ba/users/88792f6a06aa46dbaffd23048cdb7b15/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:36.506884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481a62-78f0-4da4-89cd-05e15dbe3fb0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:36.507246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481a62-78f0-4da4-89cd-05e15dbe3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:36.507598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481a62-78f0-4da4-89cd-05e15dbe3fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:36.534751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-44481a62-78f0-4da4-89cd-05e15dbe3fb0 None None] MFA Rules not processed for user `88792f6a06aa46dbaffd23048cdb7b15`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:36.536159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-44481a62-78f0-4da4-89cd-05e15dbe3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:36.597187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6b1780652c4f808c7f83b793da90ef'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.602854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6b1780652c4f808c7f83b793da90ef'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.611434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1097/2170] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:36.611434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44481a62-78f0-4da4-89cd-05e15dbe3fb0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:36.611434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-44481a62-78f0-4da4-89cd-05e15dbe3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:36.616813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6b1780652c4f808c7f83b793da90ef'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:36.624096 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1074/2171] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:36 2022] DELETE /identity/v3/users/7b6b1780652c4f808c7f83b793da90ef => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:36.624977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:36.626586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:36.684243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44481a62-78f0-4da4-89cd-05e15dbe3fb0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:36.696700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17798b28-133f-419f-837b-a43f90ee8516 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:36.703057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d9ae0-5a8e-4e13-b00d-8a55271cd21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:36.703726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d9ae0-5a8e-4e13-b00d-8a55271cd21d admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:36.704311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d9ae0-5a8e-4e13-b00d-8a55271cd21d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:36.704311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d9ae0-5a8e-4e13-b00d-8a55271cd21d admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:36.704995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d9ae0-5a8e-4e13-b00d-8a55271cd21d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:36.707374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d9ae0-5a8e-4e13-b00d-8a55271cd21d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:36.747230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:36.748121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:36.748398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:36.748670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] PATH_INFO: `/v3/projects/eb11d535e6034f2eaa5c1805956df40e` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:36.749836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb11d535e6034f2eaa5c1805956df40e)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:36.751807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:36.815638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1075/2172] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:36 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:36.819326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d9ae0-5a8e-4e13-b00d-8a55271cd21d admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:36.888033 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d9ae0-5a8e-4e13-b00d-8a55271cd21d admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:36.908186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f2d35-95d7-4e8d-94c3-c507977df92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:36.908883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f2d35-95d7-4e8d-94c3-c507977df92a admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:36.909165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f2d35-95d7-4e8d-94c3-c507977df92a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:36.909602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f2d35-95d7-4e8d-94c3-c507977df92a admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:36.910456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f2d35-95d7-4e8d-94c3-c507977df92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:36.912777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f2d35-95d7-4e8d-94c3-c507977df92a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:37.022839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb11d535e6034f2eaa5c1805956df40e', 'request_id': 'req-605e7b65-1e18-4d04-b7b3-6d74b20fc243'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.029235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb11d535e6034f2eaa5c1805956df40e', 'request_id': 'req-605e7b65-1e18-4d04-b7b3-6d74b20fc243'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.035500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb11d535e6034f2eaa5c1805956df40e', 'request_id': 'req-605e7b65-1e18-4d04-b7b3-6d74b20fc243'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.108530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1076/2173] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:36 2022] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:37.109534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f2d35-95d7-4e8d-94c3-c507977df92a admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.119043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f2d35-95d7-4e8d-94c3-c507977df92a admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:37.142026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] The token cache is being invalidate because project eb11d535e6034f2eaa5c1805956df40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:37.142395 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.143157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.144930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1098/2174] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:36 2022] DELETE /identity/v3/projects/eb11d535e6034f2eaa5c1805956df40e => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:37.148367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.150677 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:37.183630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c8099-8407-4fed-a6e8-b053cad50eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:37.184428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c8099-8407-4fed-a6e8-b053cad50eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.184710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c8099-8407-4fed-a6e8-b053cad50eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.184981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c8099-8407-4fed-a6e8-b053cad50eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.185727 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c8099-8407-4fed-a6e8-b053cad50eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:37.187332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c8099-8407-4fed-a6e8-b053cad50eb5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:37.200979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1077/2175] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:37.200979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c8099-8407-4fed-a6e8-b053cad50eb5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.200979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e01c8099-8407-4fed-a6e8-b053cad50eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:37.212431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c8099-8407-4fed-a6e8-b053cad50eb5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:37.216915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e7b65-1e18-4d04-b7b3-6d74b20fc243 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:37.217667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:37.218515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.218797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.219069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] PATH_INFO: `/v3/users/681eb2876dca4ee7be76a02dbc6651a8` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.220330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=681eb2876dca4ee7be76a02dbc6651a8)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:37.221817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:37.222220 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:37.222668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.223081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.223360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] PATH_INFO: `/v3/projects/ee5fe2e539fc4f34b509f05b17f52ab4` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.224561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5fe2e539fc4f34b509f05b17f52ab4)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:37.226500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:37.438676 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681eb2876dca4ee7be76a02dbc6651a8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.439320 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681eb2876dca4ee7be76a02dbc6651a8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.439854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5fe2e539fc4f34b509f05b17f52ab4', 'request_id': 'req-42209106-8b76-4e6a-b18e-ca2ba117083c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.445273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5fe2e539fc4f34b509f05b17f52ab4', 'request_id': 'req-42209106-8b76-4e6a-b18e-ca2ba117083c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.452040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5fe2e539fc4f34b509f05b17f52ab4', 'request_id': 'req-42209106-8b76-4e6a-b18e-ca2ba117083c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.482534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:37.511207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681eb2876dca4ee7be76a02dbc6651a8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.518771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681eb2876dca4ee7be76a02dbc6651a8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.530428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681eb2876dca4ee7be76a02dbc6651a8'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.536311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1078/2176] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:37 2022] DELETE /identity/v3/users/681eb2876dca4ee7be76a02dbc6651a8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:37.537049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.538373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:37.598978 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] The token cache is being invalidate because project ee5fe2e539fc4f34b509f05b17f52ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:37.599388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.600195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-42209106-8b76-4e6a-b18e-ca2ba117083c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:37.602567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1099/2177] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:37 2022] DELETE /identity/v3/projects/ee5fe2e539fc4f34b509f05b17f52ab4 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:37.607906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f2a9e-3278-4671-a979-95ee76eb2303 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.608353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f2a9e-3278-4671-a979-95ee76eb2303 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.608799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f2a9e-3278-4671-a979-95ee76eb2303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.614046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f188-de19-46b6-b68b-cf7ef91d6497 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:37.619186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba04faa-d034-4651-b633-6107ff70ff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:37.621061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba04faa-d034-4651-b633-6107ff70ff2e admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.621343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba04faa-d034-4651-b633-6107ff70ff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.621745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba04faa-d034-4651-b633-6107ff70ff2e admin admin] PATH_INFO: `/v3/projects/b81ec0c688a44b67835f69705e2c6a5c/users/e388c67dc69948acad250d7096c72c52/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.634581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-388f2a9e-3278-4671-a979-95ee76eb2303 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:37.637101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-388f2a9e-3278-4671-a979-95ee76eb2303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:37.645696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba04faa-d034-4651-b633-6107ff70ff2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81ec0c688a44b67835f69705e2c6a5c, user_id=e388c67dc69948acad250d7096c72c52, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:37.648956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba04faa-d034-4651-b633-6107ff70ff2e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:37.655409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1100/2178] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:37.656990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643a37-e868-481e-be6b-81bb5c9e89ec None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.657912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643a37-e868-481e-be6b-81bb5c9e89ec None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.657912 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643a37-e868-481e-be6b-81bb5c9e89ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.676359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7a643a37-e868-481e-be6b-81bb5c9e89ec None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:37.677697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7a643a37-e868-481e-be6b-81bb5c9e89ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:37.687294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1101/2179] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:37.691409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643a37-e868-481e-be6b-81bb5c9e89ec None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.701968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643a37-e868-481e-be6b-81bb5c9e89ec None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:37.706751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9455ed-c7c7-4e2d-9eda-db29f9d2780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:37.707634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9455ed-c7c7-4e2d-9eda-db29f9d2780d admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.707982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9455ed-c7c7-4e2d-9eda-db29f9d2780d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.708268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9455ed-c7c7-4e2d-9eda-db29f9d2780d admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.709059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9455ed-c7c7-4e2d-9eda-db29f9d2780d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:37.709373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9455ed-c7c7-4e2d-9eda-db29f9d2780d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:37.711079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9455ed-c7c7-4e2d-9eda-db29f9d2780d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:37.723148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1102/2180] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:41:37.736758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9455ed-c7c7-4e2d-9eda-db29f9d2780d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.747120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9455ed-c7c7-4e2d-9eda-db29f9d2780d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:37.751632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ee896-aff8-41f6-8a0b-c2077c3f9776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:37.752302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ee896-aff8-41f6-8a0b-c2077c3f9776 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.752587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ee896-aff8-41f6-8a0b-c2077c3f9776 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.752869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ee896-aff8-41f6-8a0b-c2077c3f9776 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.753543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ee896-aff8-41f6-8a0b-c2077c3f9776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:37.755437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ee896-aff8-41f6-8a0b-c2077c3f9776 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:37.832844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1079/2181] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:37 2022] PUT /identity/v3/projects/b81ec0c688a44b67835f69705e2c6a5c/users/e388c67dc69948acad250d7096c72c52/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:37.836872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba04faa-d034-4651-b633-6107ff70ff2e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.838528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4ba04faa-d034-4651-b633-6107ff70ff2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:37.902742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba04faa-d034-4651-b633-6107ff70ff2e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:37.907960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2454-b096-4d41-86d2-e5e5adee53ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:37.909341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2454-b096-4d41-86d2-e5e5adee53ef admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.909909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2454-b096-4d41-86d2-e5e5adee53ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.910171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2454-b096-4d41-86d2-e5e5adee53ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.910998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c2454-b096-4d41-86d2-e5e5adee53ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:37.912728 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c2454-b096-4d41-86d2-e5e5adee53ef admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:37.922767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1103/2182] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:37 2022] POST /identity/v3/projects => generated 409 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:37.927829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1080/2183] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:37.929482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ee896-aff8-41f6-8a0b-c2077c3f9776 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.929638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2454-b096-4d41-86d2-e5e5adee53ef admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.941334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2454-b096-4d41-86d2-e5e5adee53ef admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.012692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc29372-6422-4be9-ac75-999381a6d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.013804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc29372-6422-4be9-ac75-999381a6d798 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.013949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ee896-aff8-41f6-8a0b-c2077c3f9776 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.014379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc29372-6422-4be9-ac75-999381a6d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.014660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc29372-6422-4be9-ac75-999381a6d798 admin admin] PATH_INFO: `/v3/projects/b81ec0c688a44b67835f69705e2c6a5c/users/e388c67dc69948acad250d7096c72c52/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.016841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc29372-6422-4be9-ac75-999381a6d798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81ec0c688a44b67835f69705e2c6a5c, user_id=e388c67dc69948acad250d7096c72c52, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.019313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac5f99-65de-4e31-929e-23f2b186ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.019794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc29372-6422-4be9-ac75-999381a6d798 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.020211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac5f99-65de-4e31-929e-23f2b186ea97 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.020473 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac5f99-65de-4e31-929e-23f2b186ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.020663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac5f99-65de-4e31-929e-23f2b186ea97 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.022089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac5f99-65de-4e31-929e-23f2b186ea97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.031401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac5f99-65de-4e31-929e-23f2b186ea97 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.043358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1081/2184] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:37 2022] PUT /identity/v3/projects/b81ec0c688a44b67835f69705e2c6a5c/users/e388c67dc69948acad250d7096c72c52/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:38.057396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb3dd9-f6d8-4963-8dce-f3a3c91aac6b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.057665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb3dd9-f6d8-4963-8dce-f3a3c91aac6b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.058052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb3dd9-f6d8-4963-8dce-f3a3c91aac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.084165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-89bb3dd9-f6d8-4963-8dce-f3a3c91aac6b None None] MFA Rules not processed for user `e388c67dc69948acad250d7096c72c52`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:38.085328 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-89bb3dd9-f6d8-4963-8dce-f3a3c91aac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.112673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:38.119805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1104/2185] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:37 2022] POST /identity/v3/users => generated 305 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:38.122927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac5f99-65de-4e31-929e-23f2b186ea97 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:38.132622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac5f99-65de-4e31-929e-23f2b186ea97 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.154307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1082/2186] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:38.165592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb3dd9-f6d8-4963-8dce-f3a3c91aac6b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:38.167617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-89bb3dd9-f6d8-4963-8dce-f3a3c91aac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.191463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00fb6d-593b-4048-a60a-ee9f3f1a2b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.192177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00fb6d-593b-4048-a60a-ee9f3f1a2b55 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.192476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00fb6d-593b-4048-a60a-ee9f3f1a2b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.192736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00fb6d-593b-4048-a60a-ee9f3f1a2b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.193478 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00fb6d-593b-4048-a60a-ee9f3f1a2b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.195237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00fb6d-593b-4048-a60a-ee9f3f1a2b55 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.208262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1105/2187] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:38.209258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00fb6d-593b-4048-a60a-ee9f3f1a2b55 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:38.211501 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ca00fb6d-593b-4048-a60a-ee9f3f1a2b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.224669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00fb6d-593b-4048-a60a-ee9f3f1a2b55 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.230343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb3dd9-f6d8-4963-8dce-f3a3c91aac6b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.235378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.235378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.235378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.235378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] PATH_INFO: `/v3/projects/abb83ff8068c419782be144cf9428242` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.235699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d00dc-5223-4b23-9447-f47d0b66e881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.235699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d00dc-5223-4b23-9447-f47d0b66e881 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.235890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb83ff8068c419782be144cf9428242)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.235964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d00dc-5223-4b23-9447-f47d0b66e881 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.235964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d00dc-5223-4b23-9447-f47d0b66e881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.237253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.246609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d00dc-5223-4b23-9447-f47d0b66e881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.248301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d00dc-5223-4b23-9447-f47d0b66e881 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.263925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1083/2188] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:38.270024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d00dc-5223-4b23-9447-f47d0b66e881 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:38.278369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d00dc-5223-4b23-9447-f47d0b66e881 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.284008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bda848-7601-4c20-9e15-6c71fee8fff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.284666 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bda848-7601-4c20-9e15-6c71fee8fff0 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.284953 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bda848-7601-4c20-9e15-6c71fee8fff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.285234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bda848-7601-4c20-9e15-6c71fee8fff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.285996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bda848-7601-4c20-9e15-6c71fee8fff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.296184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bda848-7601-4c20-9e15-6c71fee8fff0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.302765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1084/2189] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:38.303626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bda848-7601-4c20-9e15-6c71fee8fff0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:38.316902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bda848-7601-4c20-9e15-6c71fee8fff0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.320205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3de930-bc4a-4b3e-96dc-b503ddd09bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.321102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de930-bc4a-4b3e-96dc-b503ddd09bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.321427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de930-bc4a-4b3e-96dc-b503ddd09bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.321717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de930-bc4a-4b3e-96dc-b503ddd09bc4 admin admin] PATH_INFO: `/v3/projects/beb8a423a01a4391b1393af3eaf62627/users/40175976636a428bb1e5caa22d4a8c97/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.337891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3de930-bc4a-4b3e-96dc-b503ddd09bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb8a423a01a4391b1393af3eaf62627, user_id=40175976636a428bb1e5caa22d4a8c97, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.341782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3de930-bc4a-4b3e-96dc-b503ddd09bc4 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.421346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1085/2190] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:38 2022] PUT /identity/v3/projects/beb8a423a01a4391b1393af3eaf62627/users/40175976636a428bb1e5caa22d4a8c97/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:38.424638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3de930-bc4a-4b3e-96dc-b503ddd09bc4 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:38.429257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb83ff8068c419782be144cf9428242', 'request_id': 'req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:38.435069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb83ff8068c419782be144cf9428242', 'request_id': 'req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:38.441731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb83ff8068c419782be144cf9428242', 'request_id': 'req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:38.480504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3de930-bc4a-4b3e-96dc-b503ddd09bc4 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.527618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d08c6a-057b-498d-b729-ecc7fd9a65a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.528283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d08c6a-057b-498d-b729-ecc7fd9a65a4 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.528563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d08c6a-057b-498d-b729-ecc7fd9a65a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.528837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d08c6a-057b-498d-b729-ecc7fd9a65a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.530660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-31d08c6a-057b-498d-b729-ecc7fd9a65a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.546486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] The token cache is being invalidate because project abb83ff8068c419782be144cf9428242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:38.546774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:38.553430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:38.553430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1106/2191] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:38 2022] DELETE /identity/v3/projects/abb83ff8068c419782be144cf9428242 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:38.553430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:38.553430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.595620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d08c6a-057b-498d-b729-ecc7fd9a65a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.595620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d08c6a-057b-498d-b729-ecc7fd9a65a4 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.604338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1086/2192] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:38.605589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e103d-752d-433e-a700-9af8570ebd95 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.605880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e103d-752d-433e-a700-9af8570ebd95 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.606160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e103d-752d-433e-a700-9af8570ebd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.615433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2d5d9-4e8f-44bd-96eb-15b92d2a78d7 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.620386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.621260 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.621541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.621815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] PATH_INFO: `/v3/users/88792f6a06aa46dbaffd23048cdb7b15` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.623015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88792f6a06aa46dbaffd23048cdb7b15)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.624991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.636113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8a9e103d-752d-433e-a700-9af8570ebd95 None None] MFA Rules not processed for user `40175976636a428bb1e5caa22d4a8c97`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:38.636113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8a9e103d-752d-433e-a700-9af8570ebd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.697634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1087/2193] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:38.699619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aeddde-8472-4d9c-b7dd-45553fcf3fc6 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.699961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aeddde-8472-4d9c-b7dd-45553fcf3fc6 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.700237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aeddde-8472-4d9c-b7dd-45553fcf3fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.718251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-89aeddde-8472-4d9c-b7dd-45553fcf3fc6 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:38.719433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-89aeddde-8472-4d9c-b7dd-45553fcf3fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.727263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1088/2194] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:38.728081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aeddde-8472-4d9c-b7dd-45553fcf3fc6 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:38.729333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-89aeddde-8472-4d9c-b7dd-45553fcf3fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.740611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aeddde-8472-4d9c-b7dd-45553fcf3fc6 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.746017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ad068-631f-483c-878d-624c9df99660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.746634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ad068-631f-483c-878d-624c9df99660 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.746914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ad068-631f-483c-878d-624c9df99660 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.747188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ad068-631f-483c-878d-624c9df99660 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.747908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ad068-631f-483c-878d-624c9df99660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.749786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ad068-631f-483c-878d-624c9df99660 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.829461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1089/2195] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:38 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:38.831619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9ec2-342a-424c-aa86-45c7df1f1031 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.831619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9ec2-342a-424c-aa86-45c7df1f1031 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.831619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9ec2-342a-424c-aa86-45c7df1f1031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.849489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-459f9ec2-342a-424c-aa86-45c7df1f1031 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:38.850644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-459f9ec2-342a-424c-aa86-45c7df1f1031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.913441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88792f6a06aa46dbaffd23048cdb7b15'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:38.914042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88792f6a06aa46dbaffd23048cdb7b15'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:38.917437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1090/2196] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:38.920931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9ec2-342a-424c-aa86-45c7df1f1031 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:38.922341 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88792f6a06aa46dbaffd23048cdb7b15'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:38.930554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9ec2-342a-424c-aa86-45c7df1f1031 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:38.935829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653900b-476a-4b28-840c-cdb695acbc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:38.936492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653900b-476a-4b28-840c-cdb695acbc62 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:38.936778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653900b-476a-4b28-840c-cdb695acbc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:38.937061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653900b-476a-4b28-840c-cdb695acbc62 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:38.937749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653900b-476a-4b28-840c-cdb695acbc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.939881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653900b-476a-4b28-840c-cdb695acbc62 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.048184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88792f6a06aa46dbaffd23048cdb7b15'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:39.061594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88792f6a06aa46dbaffd23048cdb7b15'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:39.067479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1107/2197] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:38 2022] DELETE /identity/v3/users/88792f6a06aa46dbaffd23048cdb7b15 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:39.068291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.069813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:39.088510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1091/2198] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:38 2022] POST /identity/v3/users => generated 310 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:39.090513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40889b-ff50-4f58-8ef4-3f2571a0c808 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.090806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40889b-ff50-4f58-8ef4-3f2571a0c808 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.091156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40889b-ff50-4f58-8ef4-3f2571a0c808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.108904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-de40889b-ff50-4f58-8ef4-3f2571a0c808 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:39.110103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-de40889b-ff50-4f58-8ef4-3f2571a0c808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:39.135211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfc2dc-4803-4aff-8c28-0a1816147bf5 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.140474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.141138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.141538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.141826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.142580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:39.142887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.144534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.156447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1108/2199] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:39.157494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.159156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:39.172785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1092/2200] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:39.172785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40889b-ff50-4f58-8ef4-3f2571a0c808 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.175777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d312c-d429-45b3-bbd4-2c13e1998c0a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.180874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ae15e-5d23-485e-8a1e-5d868d62938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.184259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40889b-ff50-4f58-8ef4-3f2571a0c808 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.184370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ae15e-5d23-485e-8a1e-5d868d62938a admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.184370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ae15e-5d23-485e-8a1e-5d868d62938a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.184370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ae15e-5d23-485e-8a1e-5d868d62938a admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.184370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ae15e-5d23-485e-8a1e-5d868d62938a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.185182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ae15e-5d23-485e-8a1e-5d868d62938a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.187361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34d7a9-219c-4a94-b7d4-f6485ace528b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.188074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34d7a9-219c-4a94-b7d4-f6485ace528b admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.188360 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34d7a9-219c-4a94-b7d4-f6485ace528b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.188640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34d7a9-219c-4a94-b7d4-f6485ace528b admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.189324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34d7a9-219c-4a94-b7d4-f6485ace528b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.191272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34d7a9-219c-4a94-b7d4-f6485ace528b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.198454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1109/2201] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:39.198454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ae15e-5d23-485e-8a1e-5d868d62938a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.200079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-993ae15e-5d23-485e-8a1e-5d868d62938a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:39.255248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ae15e-5d23-485e-8a1e-5d868d62938a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.262743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660dd37-f456-4744-94ad-514b8a56f683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.263532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660dd37-f456-4744-94ad-514b8a56f683 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.263854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660dd37-f456-4744-94ad-514b8a56f683 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.264133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660dd37-f456-4744-94ad-514b8a56f683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.274640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660dd37-f456-4744-94ad-514b8a56f683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.274821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1093/2202] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:39 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:39.275599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34d7a9-219c-4a94-b7d4-f6485ace528b admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.276455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660dd37-f456-4744-94ad-514b8a56f683 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.286661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1110/2203] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:39.287444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660dd37-f456-4744-94ad-514b8a56f683 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.297307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660dd37-f456-4744-94ad-514b8a56f683 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.351558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34d7a9-219c-4a94-b7d4-f6485ace528b admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.359298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b9a14-9366-40b2-9dd3-a7ccf9c2d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.361201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b9a14-9366-40b2-9dd3-a7ccf9c2d713 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.361721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b9a14-9366-40b2-9dd3-a7ccf9c2d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.362263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b9a14-9366-40b2-9dd3-a7ccf9c2d713 admin admin] PATH_INFO: `/v3/projects/531f536d88aa4c8f9f12c49f4d421842/users/891a8d6d7559452bae1c0661e4abf1d2/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.381137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061af00a-4c22-44a6-8e20-6513728ac613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.381842 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061af00a-4c22-44a6-8e20-6513728ac613 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.382129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061af00a-4c22-44a6-8e20-6513728ac613 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.382415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061af00a-4c22-44a6-8e20-6513728ac613 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.383099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061af00a-4c22-44a6-8e20-6513728ac613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.384886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b9a14-9366-40b2-9dd3-a7ccf9c2d713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531f536d88aa4c8f9f12c49f4d421842, user_id=891a8d6d7559452bae1c0661e4abf1d2, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.385059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061af00a-4c22-44a6-8e20-6513728ac613 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.388710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b9a14-9366-40b2-9dd3-a7ccf9c2d713 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.456057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1094/2204] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:39 2022] PUT /identity/v3/projects/531f536d88aa4c8f9f12c49f4d421842/users/891a8d6d7559452bae1c0661e4abf1d2/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:39.460162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b9a14-9366-40b2-9dd3-a7ccf9c2d713 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.485388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1111/2205] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:39 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:39.490256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061af00a-4c22-44a6-8e20-6513728ac613 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.506496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061af00a-4c22-44a6-8e20-6513728ac613 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.541238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b9a14-9366-40b2-9dd3-a7ccf9c2d713 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.547247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf18d2-f242-45a2-9db2-c6ff70a85d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.548036 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf18d2-f242-45a2-9db2-c6ff70a85d05 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.548394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf18d2-f242-45a2-9db2-c6ff70a85d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.549005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf18d2-f242-45a2-9db2-c6ff70a85d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.549546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf18d2-f242-45a2-9db2-c6ff70a85d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.552716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf18d2-f242-45a2-9db2-c6ff70a85d05 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.564194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1095/2206] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:39.569725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf18d2-f242-45a2-9db2-c6ff70a85d05 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.584389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf18d2-f242-45a2-9db2-c6ff70a85d05 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.590668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa0803-3fc6-4e75-8e1d-e90f3a2839b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.591559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa0803-3fc6-4e75-8e1d-e90f3a2839b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.591938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa0803-3fc6-4e75-8e1d-e90f3a2839b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.592433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa0803-3fc6-4e75-8e1d-e90f3a2839b5 admin admin] PATH_INFO: `/v3/projects/531f536d88aa4c8f9f12c49f4d421842/users/891a8d6d7559452bae1c0661e4abf1d2/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.596750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa0803-3fc6-4e75-8e1d-e90f3a2839b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531f536d88aa4c8f9f12c49f4d421842, user_id=891a8d6d7559452bae1c0661e4abf1d2, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.605199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720328c-9d80-413a-acfd-07930d17a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.605355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa0803-3fc6-4e75-8e1d-e90f3a2839b5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.606201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720328c-9d80-413a-acfd-07930d17a526 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.606740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720328c-9d80-413a-acfd-07930d17a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.607125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720328c-9d80-413a-acfd-07930d17a526 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.608403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720328c-9d80-413a-acfd-07930d17a526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.610269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720328c-9d80-413a-acfd-07930d17a526 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.628068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1096/2207] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:39 2022] PUT /identity/v3/projects/531f536d88aa4c8f9f12c49f4d421842/users/891a8d6d7559452bae1c0661e4abf1d2/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:39.631509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1112/2208] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:39.631988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa0803-3fc6-4e75-8e1d-e90f3a2839b5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.632081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e39d-e525-4ae8-9148-ffc7c588d769 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.632081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e39d-e525-4ae8-9148-ffc7c588d769 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.632081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7e39d-e525-4ae8-9148-ffc7c588d769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.669790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ada7e39d-e525-4ae8-9148-ffc7c588d769 None None] MFA Rules not processed for user `891a8d6d7559452bae1c0661e4abf1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:39.671410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ada7e39d-e525-4ae8-9148-ffc7c588d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:39.696901 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa0803-3fc6-4e75-8e1d-e90f3a2839b5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.701863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be3607-81f5-405a-a45b-16939d4cd729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.702598 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be3607-81f5-405a-a45b-16939d4cd729 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.702950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be3607-81f5-405a-a45b-16939d4cd729 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.703309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be3607-81f5-405a-a45b-16939d4cd729 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.704206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be3607-81f5-405a-a45b-16939d4cd729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.705963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be3607-81f5-405a-a45b-16939d4cd729 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.717572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1097/2209] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:39.721579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be3607-81f5-405a-a45b-16939d4cd729 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.731667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be3607-81f5-405a-a45b-16939d4cd729 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.736529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7a1b0-0fe2-4519-bda8-4842ee6f7c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.737404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7a1b0-0fe2-4519-bda8-4842ee6f7c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.737689 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7a1b0-0fe2-4519-bda8-4842ee6f7c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.737966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7a1b0-0fe2-4519-bda8-4842ee6f7c7c admin admin] PATH_INFO: `/v3/projects/7f37e4e798f14912930f72bf63ee8d5d/users/82d89b0c16994f89b6de21922bdd0e25/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.751663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1113/2210] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:39.753005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7a1b0-0fe2-4519-bda8-4842ee6f7c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f37e4e798f14912930f72bf63ee8d5d, user_id=82d89b0c16994f89b6de21922bdd0e25, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.755807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7a1b0-0fe2-4519-bda8-4842ee6f7c7c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.762795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7e39d-e525-4ae8-9148-ffc7c588d769 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.764329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ada7e39d-e525-4ae8-9148-ffc7c588d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:39.825584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7e39d-e525-4ae8-9148-ffc7c588d769 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.833460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3dd8d-155a-4c34-9456-f5b5ecf7c8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.834152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3dd8d-155a-4c34-9456-f5b5ecf7c8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.834464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3dd8d-155a-4c34-9456-f5b5ecf7c8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.834744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3dd8d-155a-4c34-9456-f5b5ecf7c8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.845679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3dd8d-155a-4c34-9456-f5b5ecf7c8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.847319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3dd8d-155a-4c34-9456-f5b5ecf7c8e5 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.859126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1114/2211] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:39.860202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3dd8d-155a-4c34-9456-f5b5ecf7c8e5 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.862003 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d1e3dd8d-155a-4c34-9456-f5b5ecf7c8e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:39.876652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3dd8d-155a-4c34-9456-f5b5ecf7c8e5 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.881330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.882169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.882452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.882748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] PATH_INFO: `/v3/projects/d7cd05ee74fc42dfa27d0c50c0aa76ba` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.883954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7cd05ee74fc42dfa27d0c50c0aa76ba)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.886787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.917857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1098/2212] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:39 2022] PUT /identity/v3/projects/7f37e4e798f14912930f72bf63ee8d5d/users/82d89b0c16994f89b6de21922bdd0e25/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:39.920259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e165c9f-4ef0-4caa-9dd2-1502a5381f1c None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.920549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e165c9f-4ef0-4caa-9dd2-1502a5381f1c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.926702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e165c9f-4ef0-4caa-9dd2-1502a5381f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.946541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8e165c9f-4ef0-4caa-9dd2-1502a5381f1c None None] MFA Rules not processed for user `82d89b0c16994f89b6de21922bdd0e25`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:39.947892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8e165c9f-4ef0-4caa-9dd2-1502a5381f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:40.016597 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1099/2213] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:40.017652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e165c9f-4ef0-4caa-9dd2-1502a5381f1c None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:40.035910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:40.056698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cd05ee74fc42dfa27d0c50c0aa76ba', 'request_id': 'req-f069ee9c-c91f-443b-ba25-9029772c4eb0'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.065582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cd05ee74fc42dfa27d0c50c0aa76ba', 'request_id': 'req-f069ee9c-c91f-443b-ba25-9029772c4eb0'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.070993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cd05ee74fc42dfa27d0c50c0aa76ba', 'request_id': 'req-f069ee9c-c91f-443b-ba25-9029772c4eb0'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.092075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e165c9f-4ef0-4caa-9dd2-1502a5381f1c None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:40.147602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] The token cache is being invalidate because project d7cd05ee74fc42dfa27d0c50c0aa76ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:40.147906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.148661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.150334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1115/2214] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:39 2022] DELETE /identity/v3/projects/d7cd05ee74fc42dfa27d0c50c0aa76ba => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:40.155205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:40.158005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:40.166123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33947e46-a189-4ddd-83ae-9014885f9084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:40.166904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33947e46-a189-4ddd-83ae-9014885f9084 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:40.167193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33947e46-a189-4ddd-83ae-9014885f9084 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:40.167471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33947e46-a189-4ddd-83ae-9014885f9084 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:40.168601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33947e46-a189-4ddd-83ae-9014885f9084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:40.170919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33947e46-a189-4ddd-83ae-9014885f9084 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:40.230006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ee9c-c91f-443b-ba25-9029772c4eb0 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:40.234633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:40.235499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:40.235803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:40.236081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] PATH_INFO: `/v3/users/e388c67dc69948acad250d7096c72c52` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:40.237303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e388c67dc69948acad250d7096c72c52)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:40.239218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:40.292044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1100/2215] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:40 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:40.296223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33947e46-a189-4ddd-83ae-9014885f9084 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:40.298146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-33947e46-a189-4ddd-83ae-9014885f9084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:40.368642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33947e46-a189-4ddd-83ae-9014885f9084 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:40.378294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b96a3-3b47-4035-b209-373225afd452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:40.378988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b96a3-3b47-4035-b209-373225afd452 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:40.379533 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b96a3-3b47-4035-b209-373225afd452 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:40.379996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b96a3-3b47-4035-b209-373225afd452 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:40.380809 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b96a3-3b47-4035-b209-373225afd452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:40.383310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b96a3-3b47-4035-b209-373225afd452 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:40.420323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:40.429130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e388c67dc69948acad250d7096c72c52'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.430245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e388c67dc69948acad250d7096c72c52'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.438339 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e388c67dc69948acad250d7096c72c52'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.467018 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1101/2216] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:40 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:40.468109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b96a3-3b47-4035-b209-373225afd452 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:40.469961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-574b96a3-3b47-4035-b209-373225afd452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:40.516844 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e388c67dc69948acad250d7096c72c52'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.535879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e388c67dc69948acad250d7096c72c52'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:40.546198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b96a3-3b47-4035-b209-373225afd452 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:40.547454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1116/2217] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:40 2022] DELETE /identity/v3/users/e388c67dc69948acad250d7096c72c52 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:40.559923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:40.561673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:40.643311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b9c0f-f5c6-4514-bdf4-8d24234c58f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:40.644291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b9c0f-f5c6-4514-bdf4-8d24234c58f0 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:40.644650 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b9c0f-f5c6-4514-bdf4-8d24234c58f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:40.645022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b9c0f-f5c6-4514-bdf4-8d24234c58f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:40.649041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8c9b9c0f-f5c6-4514-bdf4-8d24234c58f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:40.654130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bacb84-5f40-49a9-a70d-153ae9e8eb94 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:40.659498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316e68f-6864-4c90-a866-ca0a2b093938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:40.660343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e68f-6864-4c90-a866-ca0a2b093938 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:40.660631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e68f-6864-4c90-a866-ca0a2b093938 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:40.661393 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316e68f-6864-4c90-a866-ca0a2b093938 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:40.661759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316e68f-6864-4c90-a866-ca0a2b093938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:40.663404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316e68f-6864-4c90-a866-ca0a2b093938 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:40.674449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1117/2218] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:40.678149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316e68f-6864-4c90-a866-ca0a2b093938 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:40.688418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316e68f-6864-4c90-a866-ca0a2b093938 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:40.696047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63815a8a-3a13-4e3b-aeed-3823a281207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:40.699384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63815a8a-3a13-4e3b-aeed-3823a281207b admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:40.699384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63815a8a-3a13-4e3b-aeed-3823a281207b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:40.699384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63815a8a-3a13-4e3b-aeed-3823a281207b admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:40.699384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63815a8a-3a13-4e3b-aeed-3823a281207b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:40.700280 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63815a8a-3a13-4e3b-aeed-3823a281207b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:40.711976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1118/2219] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:40.716043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63815a8a-3a13-4e3b-aeed-3823a281207b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:40.730378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63815a8a-3a13-4e3b-aeed-3823a281207b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:40.730501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b9c0f-f5c6-4514-bdf4-8d24234c58f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:40.730501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b9c0f-f5c6-4514-bdf4-8d24234c58f0 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:40.732268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91320979-c5e8-4ebb-bb61-856968b7d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:40.733249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320979-c5e8-4ebb-bb61-856968b7d62a admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:40.733716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320979-c5e8-4ebb-bb61-856968b7d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:40.734452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320979-c5e8-4ebb-bb61-856968b7d62a admin admin] PATH_INFO: `/v3/projects/f36f37d53a8148508d3e85925b260298/users/74d93001d0914234b88836dca23fd79a/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:40.740934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1102/2220] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:40 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:40.770504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91320979-c5e8-4ebb-bb61-856968b7d62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f36f37d53a8148508d3e85925b260298, user_id=74d93001d0914234b88836dca23fd79a, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:40.770504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91320979-c5e8-4ebb-bb61-856968b7d62a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:40.913326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1119/2221] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:40 2022] PUT /identity/v3/projects/f36f37d53a8148508d3e85925b260298/users/74d93001d0914234b88836dca23fd79a/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:40.924642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23de9f-d4e4-4e66-a7e5-f0cfcfd13227 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:40.925150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23de9f-d4e4-4e66-a7e5-f0cfcfd13227 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:40.925150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23de9f-d4e4-4e66-a7e5-f0cfcfd13227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:40.954113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0e23de9f-d4e4-4e66-a7e5-f0cfcfd13227 None None] MFA Rules not processed for user `74d93001d0914234b88836dca23fd79a`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:40.958312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0e23de9f-d4e4-4e66-a7e5-f0cfcfd13227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.020438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1103/2222] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:41.024989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91320979-c5e8-4ebb-bb61-856968b7d62a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.090346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91320979-c5e8-4ebb-bb61-856968b7d62a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.092732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23de9f-d4e4-4e66-a7e5-f0cfcfd13227 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.094695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0e23de9f-d4e4-4e66-a7e5-f0cfcfd13227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.097513 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3fa9b-0165-41ec-a65d-f4e8117f895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.098194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3fa9b-0165-41ec-a65d-f4e8117f895b admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.098481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3fa9b-0165-41ec-a65d-f4e8117f895b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.098849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3fa9b-0165-41ec-a65d-f4e8117f895b admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.099544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3fa9b-0165-41ec-a65d-f4e8117f895b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.102741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3fa9b-0165-41ec-a65d-f4e8117f895b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.111318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23de9f-d4e4-4e66-a7e5-f0cfcfd13227 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.118026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.119061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.119695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.119695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] PATH_INFO: `/v3/projects/b81ec0c688a44b67835f69705e2c6a5c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.121823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81ec0c688a44b67835f69705e2c6a5c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.129005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.257984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1120/2223] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:41.259478 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3fa9b-0165-41ec-a65d-f4e8117f895b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.266920 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81ec0c688a44b67835f69705e2c6a5c', 'request_id': 'req-5c3d24f7-72a7-4151-9820-01f574268ed1'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.273109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81ec0c688a44b67835f69705e2c6a5c', 'request_id': 'req-5c3d24f7-72a7-4151-9820-01f574268ed1'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.324319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3fa9b-0165-41ec-a65d-f4e8117f895b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.328930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8421bc-b94a-434f-96e8-388aa2164b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.329588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8421bc-b94a-434f-96e8-388aa2164b00 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.329871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8421bc-b94a-434f-96e8-388aa2164b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.330153 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8421bc-b94a-434f-96e8-388aa2164b00 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.330825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8421bc-b94a-434f-96e8-388aa2164b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.332787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8421bc-b94a-434f-96e8-388aa2164b00 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.346912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81ec0c688a44b67835f69705e2c6a5c', 'request_id': 'req-5c3d24f7-72a7-4151-9820-01f574268ed1'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.358196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] The token cache is being invalidate because project b81ec0c688a44b67835f69705e2c6a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:41.358484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.359135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5c3d24f7-72a7-4151-9820-01f574268ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.360736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1104/2224] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:41 2022] DELETE /identity/v3/projects/b81ec0c688a44b67835f69705e2c6a5c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:41.366376 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d68548-5e12-4ce4-ac58-d76e93b0637c None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.366665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d68548-5e12-4ce4-ac58-d76e93b0637c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.366946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d68548-5e12-4ce4-ac58-d76e93b0637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.388383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-66d68548-5e12-4ce4-ac58-d76e93b0637c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:41.397901 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-66d68548-5e12-4ce4-ac58-d76e93b0637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.398822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1105/2225] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:41.407429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef15e4-dbc7-43c8-b821-e9007432fc8d None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.407429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef15e4-dbc7-43c8-b821-e9007432fc8d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.407429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef15e4-dbc7-43c8-b821-e9007432fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.426797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1121/2226] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:41.428556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d7ef15e4-dbc7-43c8-b821-e9007432fc8d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:41.430582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d7ef15e4-dbc7-43c8-b821-e9007432fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.431017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8421bc-b94a-434f-96e8-388aa2164b00 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.434316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0e8421bc-b94a-434f-96e8-388aa2164b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.445898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1106/2227] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:41.446888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef15e4-dbc7-43c8-b821-e9007432fc8d None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.460204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef15e4-dbc7-43c8-b821-e9007432fc8d None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.463182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8421bc-b94a-434f-96e8-388aa2164b00 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.465260 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7163f-4e8a-4462-87e7-656932ed7d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.465928 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7163f-4e8a-4462-87e7-656932ed7d30 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.466209 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7163f-4e8a-4462-87e7-656932ed7d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.466485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7163f-4e8a-4462-87e7-656932ed7d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.467211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7163f-4e8a-4462-87e7-656932ed7d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:41.467515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7163f-4e8a-4462-87e7-656932ed7d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.469141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7163f-4e8a-4462-87e7-656932ed7d30 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.469636 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a2502-ddff-4b24-93b6-2eb5ba366cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.470439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a2502-ddff-4b24-93b6-2eb5ba366cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.471101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a2502-ddff-4b24-93b6-2eb5ba366cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.471392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a2502-ddff-4b24-93b6-2eb5ba366cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.472182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a2502-ddff-4b24-93b6-2eb5ba366cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.474138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a2502-ddff-4b24-93b6-2eb5ba366cf3 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.488067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1107/2228] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:41.489075 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7163f-4e8a-4462-87e7-656932ed7d30 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.493825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1122/2229] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:41.493989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a2502-ddff-4b24-93b6-2eb5ba366cf3 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.506251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a2502-ddff-4b24-93b6-2eb5ba366cf3 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.509326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7163f-4e8a-4462-87e7-656932ed7d30 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.512438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2eef-4d9b-441e-8ee0-a8301423116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.513541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2eef-4d9b-441e-8ee0-a8301423116f admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.513808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2eef-4d9b-441e-8ee0-a8301423116f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.514230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2eef-4d9b-441e-8ee0-a8301423116f admin admin] PATH_INFO: `/v3/projects/3c8debaa8fa14da8996ac68cb43d79bf/users/e79f3ac8e06c4b5cae852962ea08fd25/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.517038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83262-62d5-41a7-9370-da3cd3c29825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.517782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83262-62d5-41a7-9370-da3cd3c29825 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.518067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83262-62d5-41a7-9370-da3cd3c29825 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.518350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83262-62d5-41a7-9370-da3cd3c29825 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.519292 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e83262-62d5-41a7-9370-da3cd3c29825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.522020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e83262-62d5-41a7-9370-da3cd3c29825 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.534468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2eef-4d9b-441e-8ee0-a8301423116f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8debaa8fa14da8996ac68cb43d79bf, user_id=e79f3ac8e06c4b5cae852962ea08fd25, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.538530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2eef-4d9b-441e-8ee0-a8301423116f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.657137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1123/2230] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:41 2022] PUT /identity/v3/projects/3c8debaa8fa14da8996ac68cb43d79bf/users/e79f3ac8e06c4b5cae852962ea08fd25/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:41.660781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1108/2231] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:41.661349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83262-62d5-41a7-9370-da3cd3c29825 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.663063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2eef-4d9b-441e-8ee0-a8301423116f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.745354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2eef-4d9b-441e-8ee0-a8301423116f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.751251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608c00-31b8-4e5a-a44f-736158b121b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.751984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608c00-31b8-4e5a-a44f-736158b121b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.752266 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608c00-31b8-4e5a-a44f-736158b121b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.752574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608c00-31b8-4e5a-a44f-736158b121b3 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.753316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1608c00-31b8-4e5a-a44f-736158b121b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.755825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1608c00-31b8-4e5a-a44f-736158b121b3 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.755950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83262-62d5-41a7-9370-da3cd3c29825 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.761448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fe1bb-14cc-42f6-9926-60da6a50cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.762392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe1bb-14cc-42f6-9926-60da6a50cc98 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.762675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe1bb-14cc-42f6-9926-60da6a50cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.762954 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe1bb-14cc-42f6-9926-60da6a50cc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.763692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fe1bb-14cc-42f6-9926-60da6a50cc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.766203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fe1bb-14cc-42f6-9926-60da6a50cc98 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.783785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1109/2232] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:41.784748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fe1bb-14cc-42f6-9926-60da6a50cc98 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.796067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fe1bb-14cc-42f6-9926-60da6a50cc98 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.802242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9773e11-a0f7-43ab-a5bb-84557544bd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.803189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9773e11-a0f7-43ab-a5bb-84557544bd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.803468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9773e11-a0f7-43ab-a5bb-84557544bd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.803779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9773e11-a0f7-43ab-a5bb-84557544bd56 admin admin] PATH_INFO: `/v3/projects/3c8debaa8fa14da8996ac68cb43d79bf/users/e79f3ac8e06c4b5cae852962ea08fd25/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.805800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9773e11-a0f7-43ab-a5bb-84557544bd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8debaa8fa14da8996ac68cb43d79bf, user_id=e79f3ac8e06c4b5cae852962ea08fd25, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.808545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9773e11-a0f7-43ab-a5bb-84557544bd56 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.819397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1110/2233] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:41 2022] PUT /identity/v3/projects/3c8debaa8fa14da8996ac68cb43d79bf/users/e79f3ac8e06c4b5cae852962ea08fd25/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:41.829688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d47746-b0fe-47f0-a7b7-5cc47fc2ab8b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.830672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d47746-b0fe-47f0-a7b7-5cc47fc2ab8b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.830672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d47746-b0fe-47f0-a7b7-5cc47fc2ab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.859299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-76d47746-b0fe-47f0-a7b7-5cc47fc2ab8b None None] MFA Rules not processed for user `e79f3ac8e06c4b5cae852962ea08fd25`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:41.860758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-76d47746-b0fe-47f0-a7b7-5cc47fc2ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.929912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1111/2234] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:41.942314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d47746-b0fe-47f0-a7b7-5cc47fc2ab8b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.943910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-76d47746-b0fe-47f0-a7b7-5cc47fc2ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.950382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1124/2235] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:41.954583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608c00-31b8-4e5a-a44f-736158b121b3 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.974803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608c00-31b8-4e5a-a44f-736158b121b3 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.007088 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d47746-b0fe-47f0-a7b7-5cc47fc2ab8b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.011007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b487-2a68-4100-8040-4ddf7d14d1fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.012021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b487-2a68-4100-8040-4ddf7d14d1fd service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.012292 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b487-2a68-4100-8040-4ddf7d14d1fd service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.012566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b487-2a68-4100-8040-4ddf7d14d1fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.014403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5b02b487-2a68-4100-8040-4ddf7d14d1fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.036517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e87f-66e9-4a1e-9815-92e73c2d3a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.038693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e87f-66e9-4a1e-9815-92e73c2d3a27 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.038993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e87f-66e9-4a1e-9815-92e73c2d3a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.039276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e87f-66e9-4a1e-9815-92e73c2d3a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.040103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109e87f-66e9-4a1e-9815-92e73c2d3a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.042522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109e87f-66e9-4a1e-9815-92e73c2d3a27 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.056092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1125/2236] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:42.060163 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e87f-66e9-4a1e-9815-92e73c2d3a27 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.072267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e87f-66e9-4a1e-9815-92e73c2d3a27 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.078195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e869440-638b-43f8-995a-5999fab78ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.079052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e869440-638b-43f8-995a-5999fab78ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.079414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e869440-638b-43f8-995a-5999fab78ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.079845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e869440-638b-43f8-995a-5999fab78ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.080749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e869440-638b-43f8-995a-5999fab78ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.082697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e869440-638b-43f8-995a-5999fab78ed6 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.097555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1126/2237] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:42.098985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e869440-638b-43f8-995a-5999fab78ed6 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.104015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b487-2a68-4100-8040-4ddf7d14d1fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.104932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b487-2a68-4100-8040-4ddf7d14d1fd service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.109952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e869440-638b-43f8-995a-5999fab78ed6 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.114850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a0a86-bf1e-4738-9024-2541cf5c7259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.115866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a0a86-bf1e-4738-9024-2541cf5c7259 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.116215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a0a86-bf1e-4738-9024-2541cf5c7259 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.116420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a0a86-bf1e-4738-9024-2541cf5c7259 admin admin] PATH_INFO: `/v3/projects/b2d31c62a50a4fb68278b0fa876c5947/users/f47242cac6374fc3bb067be36b9c3dc4/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.123907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1112/2238] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:42.133794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a0a86-bf1e-4738-9024-2541cf5c7259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d31c62a50a4fb68278b0fa876c5947, user_id=f47242cac6374fc3bb067be36b9c3dc4, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.137502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a0a86-bf1e-4738-9024-2541cf5c7259 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.279262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1127/2239] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:42 2022] PUT /identity/v3/projects/b2d31c62a50a4fb68278b0fa876c5947/users/f47242cac6374fc3bb067be36b9c3dc4/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:42.290629 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92514713-600b-464d-87fe-7954edfeb6fc None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.290917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92514713-600b-464d-87fe-7954edfeb6fc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.291222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92514713-600b-464d-87fe-7954edfeb6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.317618 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-92514713-600b-464d-87fe-7954edfeb6fc None None] MFA Rules not processed for user `f47242cac6374fc3bb067be36b9c3dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:42.318818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-92514713-600b-464d-87fe-7954edfeb6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.386121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1113/2240] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:42.397894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a0a86-bf1e-4738-9024-2541cf5c7259 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.399597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-144a0a86-bf1e-4738-9024-2541cf5c7259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.461604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a0a86-bf1e-4738-9024-2541cf5c7259 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.466038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91e8a1-c26f-49ad-a8a0-1a26134444d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.466686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91e8a1-c26f-49ad-a8a0-1a26134444d2 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.466970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91e8a1-c26f-49ad-a8a0-1a26134444d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.467237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91e8a1-c26f-49ad-a8a0-1a26134444d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.476413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91e8a1-c26f-49ad-a8a0-1a26134444d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.477868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91e8a1-c26f-49ad-a8a0-1a26134444d2 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.487127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1128/2241] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:42.627924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:43.093033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:44.307283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92514713-600b-464d-87fe-7954edfeb6fc None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:44.315554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92514713-600b-464d-87fe-7954edfeb6fc None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:44.319537 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc505ea-4732-437b-9da1-72e374eecf8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:44.320248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc505ea-4732-437b-9da1-72e374eecf8d service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.320531 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc505ea-4732-437b-9da1-72e374eecf8d service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.320827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc505ea-4732-437b-9da1-72e374eecf8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.322588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6bc505ea-4732-437b-9da1-72e374eecf8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:44.380194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc505ea-4732-437b-9da1-72e374eecf8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:44.381558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc505ea-4732-437b-9da1-72e374eecf8d service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:44.391095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1114/2242] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:45.102161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:45.353052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:45.903011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91e8a1-c26f-49ad-a8a0-1a26134444d2 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.964373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91e8a1-c26f-49ad-a8a0-1a26134444d2 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.969083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.969950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.970230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.970502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] PATH_INFO: `/v3/users/f47242cac6374fc3bb067be36b9c3dc4` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.971690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47242cac6374fc3bb067be36b9c3dc4)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.973713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:46.220245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47242cac6374fc3bb067be36b9c3dc4'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.220926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47242cac6374fc3bb067be36b9c3dc4'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.229289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47242cac6374fc3bb067be36b9c3dc4'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.316238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47242cac6374fc3bb067be36b9c3dc4'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.338569 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47242cac6374fc3bb067be36b9c3dc4'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.347572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1129/2243] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:45 2022] DELETE /identity/v3/users/f47242cac6374fc3bb067be36b9c3dc4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:46.352117 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b7fcf-6ebd-4957-993f-7cc90ba7e1b4 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.352567 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b7fcf-6ebd-4957-993f-7cc90ba7e1b4 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.352688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b7fcf-6ebd-4957-993f-7cc90ba7e1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.376513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3c8b7fcf-6ebd-4957-993f-7cc90ba7e1b4 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:46.379925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:46.380454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3c8b7fcf-6ebd-4957-993f-7cc90ba7e1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.380550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.429046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:46.463964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1115/2244] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:46.475634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b7fcf-6ebd-4957-993f-7cc90ba7e1b4 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:46.477251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aeb70-6dfc-4977-8477-2c24f3ba61c3 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:46.477599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3c8b7fcf-6ebd-4957-993f-7cc90ba7e1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.481652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:46.482397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.482667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.482945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.485433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.541407 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:46.559590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b7fcf-6ebd-4957-993f-7cc90ba7e1b4 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:46.562893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:46.563454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732d01d-9045-4de4-8338-cd4f05c01bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:46.564134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732d01d-9045-4de4-8338-cd4f05c01bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.564406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:46.564522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732d01d-9045-4de4-8338-cd4f05c01bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.564689 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732d01d-9045-4de4-8338-cd4f05c01bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.574082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1130/2245] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:46.578776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732d01d-9045-4de4-8338-cd4f05c01bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:46.578776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732d01d-9045-4de4-8338-cd4f05c01bf4 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:46.586230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1116/2246] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:47.103374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.104847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:47.125453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87927f34-adff-45d1-80f8-ddfd74a2f074 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.131270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.132165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.132486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.132765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] PATH_INFO: `/v3/projects/b2d31c62a50a4fb68278b0fa876c5947` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.133946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d31c62a50a4fb68278b0fa876c5947)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.135981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.282871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d31c62a50a4fb68278b0fa876c5947', 'request_id': 'req-fa8cd050-59db-4035-9ce5-03856e115b48'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.288369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d31c62a50a4fb68278b0fa876c5947', 'request_id': 'req-fa8cd050-59db-4035-9ce5-03856e115b48'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.295386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d31c62a50a4fb68278b0fa876c5947', 'request_id': 'req-fa8cd050-59db-4035-9ce5-03856e115b48'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.397145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] The token cache is being invalidate because project b2d31c62a50a4fb68278b0fa876c5947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:47.397627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.398305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fa8cd050-59db-4035-9ce5-03856e115b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.400087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1131/2247] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:47 2022] DELETE /identity/v3/projects/b2d31c62a50a4fb68278b0fa876c5947 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:48.254198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:48.368219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:49.824247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732d01d-9045-4de4-8338-cd4f05c01bf4 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:49.825739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1732d01d-9045-4de4-8338-cd4f05c01bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:49.838506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732d01d-9045-4de4-8338-cd4f05c01bf4 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:49.896299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:49.897258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:49.899922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:49.900596 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] PATH_INFO: `/v3/users/40175976636a428bb1e5caa22d4a8c97` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:49.901764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40175976636a428bb1e5caa22d4a8c97)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:49.903857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:50.161034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40175976636a428bb1e5caa22d4a8c97'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:50.161734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40175976636a428bb1e5caa22d4a8c97'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:50.278815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40175976636a428bb1e5caa22d4a8c97'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:50.289254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40175976636a428bb1e5caa22d4a8c97'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:50.307553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:50.316328 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40175976636a428bb1e5caa22d4a8c97'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:50.322905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1117/2248] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:49 2022] DELETE /identity/v3/users/40175976636a428bb1e5caa22d4a8c97 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:50.328530 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88a760-7d6d-480d-a231-d6a214466be0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:50.328821 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88a760-7d6d-480d-a231-d6a214466be0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:50.329102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88a760-7d6d-480d-a231-d6a214466be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:50.359592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-9f88a760-7d6d-480d-a231-d6a214466be0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:50.363538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9f88a760-7d6d-480d-a231-d6a214466be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:50.427180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:50.432443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1132/2249] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:50.442672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:50.444333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:50.505971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e0cc-bfbf-4d79-b928-d11b68e68830 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:50.509859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3481241-63b4-4a4d-a864-426de668e9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:50.510515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3481241-63b4-4a4d-a864-426de668e9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:50.510802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3481241-63b4-4a4d-a864-426de668e9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:50.511082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3481241-63b4-4a4d-a864-426de668e9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:50.520858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3481241-63b4-4a4d-a864-426de668e9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:50.522319 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3481241-63b4-4a4d-a864-426de668e9c7 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:50.533109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1118/2250] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:51.056525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88a760-7d6d-480d-a231-d6a214466be0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:51.058113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9f88a760-7d6d-480d-a231-d6a214466be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:51.072330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88a760-7d6d-480d-a231-d6a214466be0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:51.078515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:51.079426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:51.079714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:51.080559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] PATH_INFO: `/v3/projects/beb8a423a01a4391b1393af3eaf62627` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:51.087117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb8a423a01a4391b1393af3eaf62627)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:51.087117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:51.213175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb8a423a01a4391b1393af3eaf62627', 'request_id': 'req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.219378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb8a423a01a4391b1393af3eaf62627', 'request_id': 'req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.226625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb8a423a01a4391b1393af3eaf62627', 'request_id': 'req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.302947 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6af51-2218-48c7-96f8-456f3ecd5fb5 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:51.303417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6af51-2218-48c7-96f8-456f3ecd5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:51.303506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6af51-2218-48c7-96f8-456f3ecd5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:51.321933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-14d6af51-2218-48c7-96f8-456f3ecd5fb5 None None] MFA Rules not processed for user `9158887f572545039af31a513c2bc0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:51.323139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-14d6af51-2218-48c7-96f8-456f3ecd5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:51.342561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] The token cache is being invalidate because project beb8a423a01a4391b1393af3eaf62627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:51.343078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.344507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.346524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1133/2251] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:51 2022] DELETE /identity/v3/projects/beb8a423a01a4391b1393af3eaf62627 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:51.351228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:51.352867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:51.384041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1119/2252] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:51.438911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17f97-3ad8-4cb9-b68d-fac7f103e9a1 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:51.444120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:51.445115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:51.445406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:51.445731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] PATH_INFO: `/v3/users/891a8d6d7559452bae1c0661e4abf1d2` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:51.446984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891a8d6d7559452bae1c0661e4abf1d2)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:51.449230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:51.691629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891a8d6d7559452bae1c0661e4abf1d2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.693411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891a8d6d7559452bae1c0661e4abf1d2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.708323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891a8d6d7559452bae1c0661e4abf1d2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.732429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6af51-2218-48c7-96f8-456f3ecd5fb5 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:51.733884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-14d6af51-2218-48c7-96f8-456f3ecd5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:51.749856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6af51-2218-48c7-96f8-456f3ecd5fb5 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:51.759114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:51.760130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:51.760584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:51.760995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] PATH_INFO: `/v3/users/82d89b0c16994f89b6de21922bdd0e25` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:51.763080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d89b0c16994f89b6de21922bdd0e25)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:51.765397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:51.832880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891a8d6d7559452bae1c0661e4abf1d2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.848089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c8f381eb-62bb-4dc0-8dd8-77e2b55f5be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891a8d6d7559452bae1c0661e4abf1d2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.856048 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1134/2253] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:51 2022] DELETE /identity/v3/users/891a8d6d7559452bae1c0661e4abf1d2 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:51.983308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d89b0c16994f89b6de21922bdd0e25'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:51.983934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d89b0c16994f89b6de21922bdd0e25'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:52.072763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d89b0c16994f89b6de21922bdd0e25'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:52.081289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d89b0c16994f89b6de21922bdd0e25'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:52.093898 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d89b0c16994f89b6de21922bdd0e25'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:52.102805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1120/2254] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:51 2022] DELETE /identity/v3/users/82d89b0c16994f89b6de21922bdd0e25 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:52.104575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b2730-fbaa-4cc8-b776-75f21208d65c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:52.104971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b2730-fbaa-4cc8-b776-75f21208d65c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:52.105355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b2730-fbaa-4cc8-b776-75f21208d65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:52.134599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ff4b2730-fbaa-4cc8-b776-75f21208d65c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:52.135928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ff4b2730-fbaa-4cc8-b776-75f21208d65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:52.233840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1135/2255] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:52.250317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:52.252144 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:52.318094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037bbe3-56d8-45bb-8d30-c084792aa637 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:52.318094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d58195-c289-43af-85bc-de5164eaf242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:52.318799 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d58195-c289-43af-85bc-de5164eaf242 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:52.318984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d58195-c289-43af-85bc-de5164eaf242 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:52.319258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d58195-c289-43af-85bc-de5164eaf242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:52.329545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d58195-c289-43af-85bc-de5164eaf242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:52.331059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d58195-c289-43af-85bc-de5164eaf242 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:52.342549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b2730-fbaa-4cc8-b776-75f21208d65c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:52.343949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ff4b2730-fbaa-4cc8-b776-75f21208d65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:52.349080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1121/2256] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:52.366736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b2730-fbaa-4cc8-b776-75f21208d65c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:52.376369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:52.377337 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:52.377688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:52.378085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] PATH_INFO: `/v3/projects/531f536d88aa4c8f9f12c49f4d421842` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:52.379357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=531f536d88aa4c8f9f12c49f4d421842)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:52.381976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:52.549098 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531f536d88aa4c8f9f12c49f4d421842', 'request_id': 'req-27b5245d-4555-40eb-b2d7-59505b063503'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:52.553362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:52.560132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531f536d88aa4c8f9f12c49f4d421842', 'request_id': 'req-27b5245d-4555-40eb-b2d7-59505b063503'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:52.567859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531f536d88aa4c8f9f12c49f4d421842', 'request_id': 'req-27b5245d-4555-40eb-b2d7-59505b063503'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:52.661670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] The token cache is being invalidate because project 531f536d88aa4c8f9f12c49f4d421842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:52.662232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:52.663029 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-27b5245d-4555-40eb-b2d7-59505b063503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:52.664824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1136/2257] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:52 2022] DELETE /identity/v3/projects/531f536d88aa4c8f9f12c49f4d421842 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:52.670314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b761d4-fa85-4324-9897-2db7a5698aff None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:52.670605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b761d4-fa85-4324-9897-2db7a5698aff None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:52.670890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b761d4-fa85-4324-9897-2db7a5698aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:52.691133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:52.695949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-a8b761d4-fa85-4324-9897-2db7a5698aff None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:52.697778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a8b761d4-fa85-4324-9897-2db7a5698aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:52.773119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1122/2258] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:52.781164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a7d6d-70d6-41ab-9f19-8a35f4e8840b None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:52.781464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a7d6d-70d6-41ab-9f19-8a35f4e8840b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:52.781749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a7d6d-70d6-41ab-9f19-8a35f4e8840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:52.802807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-313a7d6d-70d6-41ab-9f19-8a35f4e8840b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:52.804241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-313a7d6d-70d6-41ab-9f19-8a35f4e8840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:52.812361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b761d4-fa85-4324-9897-2db7a5698aff None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:52.818931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1137/2259] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:52.819906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a7d6d-70d6-41ab-9f19-8a35f4e8840b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:52.840049 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a8b761d4-fa85-4324-9897-2db7a5698aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:52.849292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a7d6d-70d6-41ab-9f19-8a35f4e8840b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:52.855040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d3d73-b282-45db-a7f5-04deaeb7541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:52.856691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b761d4-fa85-4324-9897-2db7a5698aff None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:52.861345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d3d73-b282-45db-a7f5-04deaeb7541b admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:52.861345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d3d73-b282-45db-a7f5-04deaeb7541b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:52.861345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d3d73-b282-45db-a7f5-04deaeb7541b admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:52.861345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d3d73-b282-45db-a7f5-04deaeb7541b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:52.861345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d3d73-b282-45db-a7f5-04deaeb7541b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:52.861814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d3d73-b282-45db-a7f5-04deaeb7541b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:52.862694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:52.863929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:52.864373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:52.865311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] PATH_INFO: `/v3/projects/7f37e4e798f14912930f72bf63ee8d5d` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:52.867035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f37e4e798f14912930f72bf63ee8d5d)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:52.869270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:52.889890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1138/2260] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:52.894028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d3d73-b282-45db-a7f5-04deaeb7541b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:52.921781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d3d73-b282-45db-a7f5-04deaeb7541b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:52.936362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5f4c0-919b-49f0-b5dd-195e29bf3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:52.937193 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5f4c0-919b-49f0-b5dd-195e29bf3f5b admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:52.937494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5f4c0-919b-49f0-b5dd-195e29bf3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:52.937780 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5f4c0-919b-49f0-b5dd-195e29bf3f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:52.938539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5f4c0-919b-49f0-b5dd-195e29bf3f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:52.940852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5f4c0-919b-49f0-b5dd-195e29bf3f5b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:53.013612 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f37e4e798f14912930f72bf63ee8d5d', 'request_id': 'req-4927e57a-4205-4c28-88b9-7b207f84947c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.020038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f37e4e798f14912930f72bf63ee8d5d', 'request_id': 'req-4927e57a-4205-4c28-88b9-7b207f84947c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.098566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1139/2261] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:52 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:53.099605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5f4c0-919b-49f0-b5dd-195e29bf3f5b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:53.118127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f37e4e798f14912930f72bf63ee8d5d', 'request_id': 'req-4927e57a-4205-4c28-88b9-7b207f84947c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.132466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] The token cache is being invalidate because project 7f37e4e798f14912930f72bf63ee8d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:53.132466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.134103 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.139369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1123/2262] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:52 2022] DELETE /identity/v3/projects/7f37e4e798f14912930f72bf63ee8d5d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:53.141671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:53.157098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:53.198903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5f4c0-919b-49f0-b5dd-195e29bf3f5b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:53.203776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f29ec-9135-4eea-93b9-b38d66e566ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:53.204441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f29ec-9135-4eea-93b9-b38d66e566ff admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:53.204723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f29ec-9135-4eea-93b9-b38d66e566ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:53.205002 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f29ec-9135-4eea-93b9-b38d66e566ff admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:53.205680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f29ec-9135-4eea-93b9-b38d66e566ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:53.207761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f29ec-9135-4eea-93b9-b38d66e566ff admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:53.229810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927e57a-4205-4c28-88b9-7b207f84947c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:53.234579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:53.235444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:53.235726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:53.236042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] PATH_INFO: `/v3/users/74d93001d0914234b88836dca23fd79a` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:53.237231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d93001d0914234b88836dca23fd79a)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:53.239161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:53.344388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1140/2263] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:53 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:53.345468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f29ec-9135-4eea-93b9-b38d66e566ff admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:53.347230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d09f29ec-9135-4eea-93b9-b38d66e566ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:53.363323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f29ec-9135-4eea-93b9-b38d66e566ff admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:53.368390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fb941-42b0-40e7-962a-72e2375705e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:53.369903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fb941-42b0-40e7-962a-72e2375705e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:53.370558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fb941-42b0-40e7-962a-72e2375705e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:53.370963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fb941-42b0-40e7-962a-72e2375705e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:53.372302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fb941-42b0-40e7-962a-72e2375705e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:53.374587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fb941-42b0-40e7-962a-72e2375705e9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:53.388837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1141/2264] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:53.390310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fb941-42b0-40e7-962a-72e2375705e9 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:53.401397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fb941-42b0-40e7-962a-72e2375705e9 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:53.416200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685617f-2218-4822-baa2-c5c21fc96257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:53.416886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685617f-2218-4822-baa2-c5c21fc96257 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:53.417170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685617f-2218-4822-baa2-c5c21fc96257 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:53.417445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685617f-2218-4822-baa2-c5c21fc96257 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:53.418220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685617f-2218-4822-baa2-c5c21fc96257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:53.427093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685617f-2218-4822-baa2-c5c21fc96257 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:53.430514 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1142/2265] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:53.435495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685617f-2218-4822-baa2-c5c21fc96257 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:53.445918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685617f-2218-4822-baa2-c5c21fc96257 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:53.449856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d93001d0914234b88836dca23fd79a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.450613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d93001d0914234b88836dca23fd79a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.452412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfd79e-93f4-4f3a-aef4-a3644c324171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:53.453475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfd79e-93f4-4f3a-aef4-a3644c324171 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:53.453809 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfd79e-93f4-4f3a-aef4-a3644c324171 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:53.454088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfd79e-93f4-4f3a-aef4-a3644c324171 admin admin] PATH_INFO: `/v3/projects/d5a877373ed74eabb1a9b2abadf04673/users/10da0f92228849768bb3a4cd9e4ff6fe/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:53.470286 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfd79e-93f4-4f3a-aef4-a3644c324171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a877373ed74eabb1a9b2abadf04673, user_id=10da0f92228849768bb3a4cd9e4ff6fe, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:53.473077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfd79e-93f4-4f3a-aef4-a3644c324171 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:53.523759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d93001d0914234b88836dca23fd79a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.532292 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d93001d0914234b88836dca23fd79a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.546902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5e6106f7-e0d8-4d9d-9f72-f31ce9905b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d93001d0914234b88836dca23fd79a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:53.554197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1124/2266] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:53 2022] DELETE /identity/v3/users/74d93001d0914234b88836dca23fd79a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:53.599864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1143/2267] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:53 2022] PUT /identity/v3/projects/d5a877373ed74eabb1a9b2abadf04673/users/10da0f92228849768bb3a4cd9e4ff6fe/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:53.611325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9c19-f40d-4fdf-9da6-9e91ff1ec196 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:53.611892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9c19-f40d-4fdf-9da6-9e91ff1ec196 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:53.612185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9c19-f40d-4fdf-9da6-9e91ff1ec196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:53.640147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7ffc9c19-f40d-4fdf-9da6-9e91ff1ec196 None None] MFA Rules not processed for user `10da0f92228849768bb3a4cd9e4ff6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:53.641298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7ffc9c19-f40d-4fdf-9da6-9e91ff1ec196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:53.705131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1125/2268] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:53.709614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfd79e-93f4-4f3a-aef4-a3644c324171 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:53.711361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-30bfd79e-93f4-4f3a-aef4-a3644c324171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:53.781191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfd79e-93f4-4f3a-aef4-a3644c324171 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:53.786024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffc8b7-87bb-4b43-b539-496668702a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:53.786688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffc8b7-87bb-4b43-b539-496668702a84 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:53.786973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffc8b7-87bb-4b43-b539-496668702a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:53.787253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffc8b7-87bb-4b43-b539-496668702a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:53.788015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffc8b7-87bb-4b43-b539-496668702a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:53.790084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffc8b7-87bb-4b43-b539-496668702a84 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:53.898406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1144/2269] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:53 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:53.902498 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc9c19-f40d-4fdf-9da6-9e91ff1ec196 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:53.913346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc9c19-f40d-4fdf-9da6-9e91ff1ec196 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:53.969701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb5f82-2ced-4fe6-8d31-d9341a1f0c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:53.970533 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb5f82-2ced-4fe6-8d31-d9341a1f0c93 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:53.970820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb5f82-2ced-4fe6-8d31-d9341a1f0c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:53.971124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb5f82-2ced-4fe6-8d31-d9341a1f0c93 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:53.971886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb5f82-2ced-4fe6-8d31-d9341a1f0c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:53.973852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb5f82-2ced-4fe6-8d31-d9341a1f0c93 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:54.005387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffc8b7-87bb-4b43-b539-496668702a84 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:54.007067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e4ffc8b7-87bb-4b43-b539-496668702a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:54.031678 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffc8b7-87bb-4b43-b539-496668702a84 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:54.050816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:54.051954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:54.052238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:54.052517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] PATH_INFO: `/v3/projects/f36f37d53a8148508d3e85925b260298` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:54.053734 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f36f37d53a8148508d3e85925b260298)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:54.055671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:54.121079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1126/2270] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:53 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:54.122164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb5f82-2ced-4fe6-8d31-d9341a1f0c93 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:54.132004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb5f82-2ced-4fe6-8d31-d9341a1f0c93 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:54.137313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57551a59-fbf5-4c69-af93-d5456cc758ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:54.138016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551a59-fbf5-4c69-af93-d5456cc758ce admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:54.138301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551a59-fbf5-4c69-af93-d5456cc758ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:54.138579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551a59-fbf5-4c69-af93-d5456cc758ce admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:54.139304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57551a59-fbf5-4c69-af93-d5456cc758ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:54.140972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57551a59-fbf5-4c69-af93-d5456cc758ce admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:54.153231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1127/2271] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:54.159988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57551a59-fbf5-4c69-af93-d5456cc758ce admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:54.169338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57551a59-fbf5-4c69-af93-d5456cc758ce admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:54.173913 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad904f3f-2985-4464-93c9-7857239ea029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:54.174757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad904f3f-2985-4464-93c9-7857239ea029 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:54.175055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad904f3f-2985-4464-93c9-7857239ea029 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:54.175314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad904f3f-2985-4464-93c9-7857239ea029 admin admin] PATH_INFO: `/v3/projects/44cb7567232341d096206d2f8774a002/users/899c6c461e564b798d8ef6395d69e68c/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:54.189438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad904f3f-2985-4464-93c9-7857239ea029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44cb7567232341d096206d2f8774a002, user_id=899c6c461e564b798d8ef6395d69e68c, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:54.192134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad904f3f-2985-4464-93c9-7857239ea029 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:54.289919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1128/2272] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:54 2022] PUT /identity/v3/projects/44cb7567232341d096206d2f8774a002/users/899c6c461e564b798d8ef6395d69e68c/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:54.293738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad904f3f-2985-4464-93c9-7857239ea029 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:54.297700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f36f37d53a8148508d3e85925b260298', 'request_id': 'req-74d81b32-edfa-4723-b135-3c4b35148ba2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:54.303123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f36f37d53a8148508d3e85925b260298', 'request_id': 'req-74d81b32-edfa-4723-b135-3c4b35148ba2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:54.310056 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f36f37d53a8148508d3e85925b260298', 'request_id': 'req-74d81b32-edfa-4723-b135-3c4b35148ba2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:54.352663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad904f3f-2985-4464-93c9-7857239ea029 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:54.410048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b39760-7c7f-4284-bd56-10b345ed9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:54.410642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b39760-7c7f-4284-bd56-10b345ed9773 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:54.410927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b39760-7c7f-4284-bd56-10b345ed9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:54.411263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b39760-7c7f-4284-bd56-10b345ed9773 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:54.412043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b39760-7c7f-4284-bd56-10b345ed9773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:54.413657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b39760-7c7f-4284-bd56-10b345ed9773 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:54.427829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1129/2273] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:54.429237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b39760-7c7f-4284-bd56-10b345ed9773 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:54.444908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b39760-7c7f-4284-bd56-10b345ed9773 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:54.445499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e94002-3a09-424a-a6d3-2fea5ed0d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:54.446106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e94002-3a09-424a-a6d3-2fea5ed0d6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:54.446393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e94002-3a09-424a-a6d3-2fea5ed0d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:54.446674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e94002-3a09-424a-a6d3-2fea5ed0d6cc admin admin] PATH_INFO: `/v3/projects/44cb7567232341d096206d2f8774a002/users/899c6c461e564b798d8ef6395d69e68c/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:54.448736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e94002-3a09-424a-a6d3-2fea5ed0d6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=44cb7567232341d096206d2f8774a002, user_id=899c6c461e564b798d8ef6395d69e68c, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:54.452173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e94002-3a09-424a-a6d3-2fea5ed0d6cc admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:54.466816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] The token cache is being invalidate because project f36f37d53a8148508d3e85925b260298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:54.467291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:54.468799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:54.471022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1145/2274] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:54 2022] DELETE /identity/v3/projects/f36f37d53a8148508d3e85925b260298 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:54.475051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:54.476727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:54.484655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1130/2275] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:54 2022] PUT /identity/v3/projects/44cb7567232341d096206d2f8774a002/users/899c6c461e564b798d8ef6395d69e68c/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:54.494673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f4a3-415a-40af-b36c-f58bc3c18f43 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:54.495269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f4a3-415a-40af-b36c-f58bc3c18f43 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:54.496465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f4a3-415a-40af-b36c-f58bc3c18f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:54.501272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81b32-edfa-4723-b135-3c4b35148ba2 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:54.540365 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0842f4a3-415a-40af-b36c-f58bc3c18f43 None None] MFA Rules not processed for user `899c6c461e564b798d8ef6395d69e68c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:54.542683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0842f4a3-415a-40af-b36c-f58bc3c18f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:54.592551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:54.594790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:54.595983 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:54.596551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] PATH_INFO: `/v3/users/e79f3ac8e06c4b5cae852962ea08fd25` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:54.599008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79f3ac8e06c4b5cae852962ea08fd25)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:54.602302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:54.650336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1131/2276] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:54.661199 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842f4a3-415a-40af-b36c-f58bc3c18f43 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:54.662558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0842f4a3-415a-40af-b36c-f58bc3c18f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:54.721005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842f4a3-415a-40af-b36c-f58bc3c18f43 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:54.725026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa6999-e41d-4938-849f-1de8a6b938b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:54.725889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa6999-e41d-4938-849f-1de8a6b938b2 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:54.726181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa6999-e41d-4938-849f-1de8a6b938b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:54.726640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa6999-e41d-4938-849f-1de8a6b938b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:54.728724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-19fa6999-e41d-4938-849f-1de8a6b938b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:54.794621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa6999-e41d-4938-849f-1de8a6b938b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:54.796140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa6999-e41d-4938-849f-1de8a6b938b2 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:54.806797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1132/2277] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:54.946947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79f3ac8e06c4b5cae852962ea08fd25'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:54.948294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79f3ac8e06c4b5cae852962ea08fd25'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:54.958276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79f3ac8e06c4b5cae852962ea08fd25'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:55.090543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:55.098330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79f3ac8e06c4b5cae852962ea08fd25'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:55.114587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0d032584-6b67-4368-b220-1f81bf40ec44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79f3ac8e06c4b5cae852962ea08fd25'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:55.120882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1146/2278] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:54 2022] DELETE /identity/v3/users/e79f3ac8e06c4b5cae852962ea08fd25 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:55.294221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:55.870422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa6999-e41d-4938-849f-1de8a6b938b2 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:55.884929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa6999-e41d-4938-849f-1de8a6b938b2 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:55.964285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:55.965594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:55.966046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:55.966336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] PATH_INFO: `/v3/projects/3c8debaa8fa14da8996ac68cb43d79bf` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:55.967702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8debaa8fa14da8996ac68cb43d79bf)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:55.969612 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:56.114950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8debaa8fa14da8996ac68cb43d79bf', 'request_id': 'req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:56.122054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8debaa8fa14da8996ac68cb43d79bf', 'request_id': 'req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:56.226815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8debaa8fa14da8996ac68cb43d79bf', 'request_id': 'req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:56.238521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] The token cache is being invalidate because project 3c8debaa8fa14da8996ac68cb43d79bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:56.241574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:56.241574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a3e0c5f6-0573-4b61-a99e-6259496ddc3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:56.241574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1133/2279] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:55 2022] DELETE /identity/v3/projects/3c8debaa8fa14da8996ac68cb43d79bf => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:56.246076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef808b-718b-4ac2-b43c-093139f02a0e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:56.247111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef808b-718b-4ac2-b43c-093139f02a0e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:56.247208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef808b-718b-4ac2-b43c-093139f02a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:56.270507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-10ef808b-718b-4ac2-b43c-093139f02a0e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:56.270507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-10ef808b-718b-4ac2-b43c-093139f02a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:56.346487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1147/2280] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:56.350512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d654a-363a-4a16-8c99-35a2e2ebb79c None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:56.351044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d654a-363a-4a16-8c99-35a2e2ebb79c None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:56.351437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d654a-363a-4a16-8c99-35a2e2ebb79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:56.373532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-485d654a-363a-4a16-8c99-35a2e2ebb79c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:56.376619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-485d654a-363a-4a16-8c99-35a2e2ebb79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:56.384654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1134/2281] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:56.390029 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef808b-718b-4ac2-b43c-093139f02a0e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:56.406283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef808b-718b-4ac2-b43c-093139f02a0e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:56.412889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a0a8-7a8c-4a3a-9351-485bfb5398e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:56.413693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a0a8-7a8c-4a3a-9351-485bfb5398e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:56.414074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a0a8-7a8c-4a3a-9351-485bfb5398e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:56.414379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a0a8-7a8c-4a3a-9351-485bfb5398e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:56.415187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1a0a8-7a8c-4a3a-9351-485bfb5398e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:56.415562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1a0a8-7a8c-4a3a-9351-485bfb5398e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:56.418434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1a0a8-7a8c-4a3a-9351-485bfb5398e7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:56.442305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1148/2282] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:56.449481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d654a-363a-4a16-8c99-35a2e2ebb79c None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:56.476342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d654a-363a-4a16-8c99-35a2e2ebb79c None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:56.484560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1a770-4f86-4418-95f0-d67efd1ca99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:56.485397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1a770-4f86-4418-95f0-d67efd1ca99e admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:56.485751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1a770-4f86-4418-95f0-d67efd1ca99e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:56.486216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1a770-4f86-4418-95f0-d67efd1ca99e admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:56.487043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1a770-4f86-4418-95f0-d67efd1ca99e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:56.490233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1a770-4f86-4418-95f0-d67efd1ca99e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:56.587429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1135/2283] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:56 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:56.591574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a0a8-7a8c-4a3a-9351-485bfb5398e7 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:56.605216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a0a8-7a8c-4a3a-9351-485bfb5398e7 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:56.741850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292ce6b-c3ca-43be-9959-b31bacaaa3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:56.742554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292ce6b-c3ca-43be-9959-b31bacaaa3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:56.742847 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292ce6b-c3ca-43be-9959-b31bacaaa3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:56.743529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292ce6b-c3ca-43be-9959-b31bacaaa3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:56.744145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292ce6b-c3ca-43be-9959-b31bacaaa3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:56.746044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292ce6b-c3ca-43be-9959-b31bacaaa3c5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:56.874726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1149/2284] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:56 2022] POST /identity/v3/users => generated 282 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:56.878786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1a770-4f86-4418-95f0-d67efd1ca99e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:56.889603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1a770-4f86-4418-95f0-d67efd1ca99e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:56.894574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f54225-bb53-4c05-8dce-36acb57da041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:56.895346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f54225-bb53-4c05-8dce-36acb57da041 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:56.895634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f54225-bb53-4c05-8dce-36acb57da041 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:56.895936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f54225-bb53-4c05-8dce-36acb57da041 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:56.896825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f54225-bb53-4c05-8dce-36acb57da041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:56.898471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f54225-bb53-4c05-8dce-36acb57da041 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:56.913333 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1136/2285] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:56.921447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292ce6b-c3ca-43be-9959-b31bacaaa3c5 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:56.932391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292ce6b-c3ca-43be-9959-b31bacaaa3c5 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:56.937710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8775-da90-4257-80ec-e9feac22de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:56.938421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8775-da90-4257-80ec-e9feac22de1a admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:56.938710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8775-da90-4257-80ec-e9feac22de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:56.938993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8775-da90-4257-80ec-e9feac22de1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:56.939800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f8775-da90-4257-80ec-e9feac22de1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:56.941535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f8775-da90-4257-80ec-e9feac22de1a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:56.953571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1150/2286] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:56.957924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f54225-bb53-4c05-8dce-36acb57da041 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:56.970198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f54225-bb53-4c05-8dce-36acb57da041 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:56.975673 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29979872-45f0-4203-ad6f-fb5e02217ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:56.976653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979872-45f0-4203-ad6f-fb5e02217ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:56.976991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979872-45f0-4203-ad6f-fb5e02217ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:56.977385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979872-45f0-4203-ad6f-fb5e02217ad6 admin admin] PATH_INFO: `/v3/projects/cc2fc4effeba4c799135e32cc302ee2a/users/15e8b4ad668d4481a0dd656474fa11dd/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:56.995164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29979872-45f0-4203-ad6f-fb5e02217ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2fc4effeba4c799135e32cc302ee2a, user_id=15e8b4ad668d4481a0dd656474fa11dd, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:56.997798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29979872-45f0-4203-ad6f-fb5e02217ad6 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:57.083158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1137/2287] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:56 2022] PUT /identity/v3/projects/cc2fc4effeba4c799135e32cc302ee2a/users/15e8b4ad668d4481a0dd656474fa11dd/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:57.092722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fe200-0331-42d6-a98f-2bef7d2d9fab None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:57.093107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fe200-0331-42d6-a98f-2bef7d2d9fab None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:57.093810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fe200-0331-42d6-a98f-2bef7d2d9fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:57.125463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-856fe200-0331-42d6-a98f-2bef7d2d9fab None None] MFA Rules not processed for user `15e8b4ad668d4481a0dd656474fa11dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:57.126788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-856fe200-0331-42d6-a98f-2bef7d2d9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:57.130216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:57.207951 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1151/2288] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:57.220533 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29979872-45f0-4203-ad6f-fb5e02217ad6 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:57.222331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-29979872-45f0-4203-ad6f-fb5e02217ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:57.286649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29979872-45f0-4203-ad6f-fb5e02217ad6 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:57.290335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33990c-a0f4-4535-a23a-4d23bd3f50e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:57.291000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33990c-a0f4-4535-a23a-4d23bd3f50e1 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:57.291289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33990c-a0f4-4535-a23a-4d23bd3f50e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:57.291571 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33990c-a0f4-4535-a23a-4d23bd3f50e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:57.300982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:57.306158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33990c-a0f4-4535-a23a-4d23bd3f50e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:57.307832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33990c-a0f4-4535-a23a-4d23bd3f50e1 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:57.321099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1138/2289] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:58.593190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0f928-d630-456e-9f64-20b280e6d84e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:58.593722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0f928-d630-456e-9f64-20b280e6d84e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:58.593822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0f928-d630-456e-9f64-20b280e6d84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:58.612007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-57a0f928-d630-456e-9f64-20b280e6d84e None None] MFA Rules not processed for user `0dd27b6f42d3412e94e582391a00474c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:58.613312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-57a0f928-d630-456e-9f64-20b280e6d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:58.667295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1152/2290] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:41:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:58.884503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:59.936157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:00.583245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:00.867177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45991-ca53-4651-8e62-72102ade9b41 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.867467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45991-ca53-4651-8e62-72102ade9b41 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.867813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45991-ca53-4651-8e62-72102ade9b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.887805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-abf45991-ca53-4651-8e62-72102ade9b41 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:00.889011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-abf45991-ca53-4651-8e62-72102ade9b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:00.944233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1139/2291] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:00.997091 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0f928-d630-456e-9f64-20b280e6d84e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.999400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-57a0f928-d630-456e-9f64-20b280e6d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:01.084155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0f928-d630-456e-9f64-20b280e6d84e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:01.089254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f55ea-ac17-4e84-ac71-d8cf17e9de4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:01.090471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f55ea-ac17-4e84-ac71-d8cf17e9de4b service swift] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:01.090915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f55ea-ac17-4e84-ac71-d8cf17e9de4b service swift] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:01.091334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f55ea-ac17-4e84-ac71-d8cf17e9de4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:01.099857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f55ea-ac17-4e84-ac71-d8cf17e9de4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:01.101442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f55ea-ac17-4e84-ac71-d8cf17e9de4b service swift] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:01.109731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1153/2292] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:42:01.347879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:01.840334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf45991-ca53-4651-8e62-72102ade9b41 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:01.851262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf45991-ca53-4651-8e62-72102ade9b41 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:01.856886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6452bc-4f0f-45e5-861e-392f8f12702c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:01.858106 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6452bc-4f0f-45e5-861e-392f8f12702c service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:01.858605 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6452bc-4f0f-45e5-861e-392f8f12702c service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:01.859120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6452bc-4f0f-45e5-861e-392f8f12702c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:01.862032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6c6452bc-4f0f-45e5-861e-392f8f12702c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:01.971335 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6452bc-4f0f-45e5-861e-392f8f12702c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:01.972670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6452bc-4f0f-45e5-861e-392f8f12702c service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:01.985614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1140/2293] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:02.107318 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:03.477477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:05.115305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:06.467042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:06.740537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f55ea-ac17-4e84-ac71-d8cf17e9de4b service swift] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:06.742490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-717f55ea-ac17-4e84-ac71-d8cf17e9de4b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:06.853337 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f55ea-ac17-4e84-ac71-d8cf17e9de4b service swift] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:06.860136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:06.863794 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:06.864275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:06.864712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] PATH_INFO: `/v3/users/d05983b7dd5c4018a7c2dbfcfadbd5cb` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:06.866324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05983b7dd5c4018a7c2dbfcfadbd5cb)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:06.868764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:07.126322 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:07.144578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05983b7dd5c4018a7c2dbfcfadbd5cb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:07.145596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05983b7dd5c4018a7c2dbfcfadbd5cb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:07.169162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05983b7dd5c4018a7c2dbfcfadbd5cb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:07.290121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05983b7dd5c4018a7c2dbfcfadbd5cb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:07.308528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05983b7dd5c4018a7c2dbfcfadbd5cb'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:07.322586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1154/2294] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:06 2022] DELETE /identity/v3/users/d05983b7dd5c4018a7c2dbfcfadbd5cb => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:07.661482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6452bc-4f0f-45e5-861e-392f8f12702c service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:07.676604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6452bc-4f0f-45e5-861e-392f8f12702c service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:07.753205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:07.754102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:07.754387 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:07.754667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] PATH_INFO: `/v3/projects/51cc8fb70b8245918868eb71ba7b2845` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:07.755882 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51cc8fb70b8245918868eb71ba7b2845)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:07.758251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:07.967635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51cc8fb70b8245918868eb71ba7b2845', 'request_id': 'req-ea31ccde-71c0-4345-ba10-892a148696a0'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:07.990275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51cc8fb70b8245918868eb71ba7b2845', 'request_id': 'req-ea31ccde-71c0-4345-ba10-892a148696a0'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:08.101008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51cc8fb70b8245918868eb71ba7b2845', 'request_id': 'req-ea31ccde-71c0-4345-ba10-892a148696a0'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:08.125278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] The token cache is being invalidate because project 51cc8fb70b8245918868eb71ba7b2845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:08.127864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:08.129257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:08.139574 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1141/2295] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:07 2022] DELETE /identity/v3/projects/51cc8fb70b8245918868eb71ba7b2845 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:08.139823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:08.139823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:08.160479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1990-822f-4b55-9414-f6b4bdf2a785 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:08.266272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:08.267723 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:08.268265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:08.268913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] PATH_INFO: `/v3/users/be6465bce2f548bdad2579c5518a93be` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:08.270715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6465bce2f548bdad2579c5518a93be)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:08.273177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:08.524853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:08.565816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6465bce2f548bdad2579c5518a93be'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:08.565816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6465bce2f548bdad2579c5518a93be'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:08.595776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6465bce2f548bdad2579c5518a93be'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:08.676494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6465bce2f548bdad2579c5518a93be'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:08.700416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6465bce2f548bdad2579c5518a93be'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:08.718898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1155/2296] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:08 2022] DELETE /identity/v3/users/be6465bce2f548bdad2579c5518a93be => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:09.315994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:09.317514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:09.406725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31ccde-71c0-4345-ba10-892a148696a0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:09.474311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:09.475112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:09.475397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:09.475675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] PATH_INFO: `/v3/users/10da0f92228849768bb3a4cd9e4ff6fe` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:09.479378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10da0f92228849768bb3a4cd9e4ff6fe)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:09.481963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:09.575346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:09.576843 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:09.655771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:09.660123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cdd93-9b5d-43f4-866f-77523c29e120 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:09.666816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:09.667945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:09.668309 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:09.668797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] PATH_INFO: `/v3/projects/944ca37607d04ae29c5dd35e708cc086` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:09.670149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944ca37607d04ae29c5dd35e708cc086)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:09.674248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:09.828678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10da0f92228849768bb3a4cd9e4ff6fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:09.831071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10da0f92228849768bb3a4cd9e4ff6fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:09.849053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944ca37607d04ae29c5dd35e708cc086', 'request_id': 'req-d264d67f-a2a1-4000-9f2f-26c61fde5610'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:09.859009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944ca37607d04ae29c5dd35e708cc086', 'request_id': 'req-d264d67f-a2a1-4000-9f2f-26c61fde5610'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:09.866060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944ca37607d04ae29c5dd35e708cc086', 'request_id': 'req-d264d67f-a2a1-4000-9f2f-26c61fde5610'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:10.004773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10da0f92228849768bb3a4cd9e4ff6fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:10.016810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10da0f92228849768bb3a4cd9e4ff6fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:10.044658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9fd3d4-e140-4c23-8eb8-5962567f2c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10da0f92228849768bb3a4cd9e4ff6fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:10.053501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1142/2297] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:09 2022] DELETE /identity/v3/users/10da0f92228849768bb3a4cd9e4ff6fe => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:10.058532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e5a8-85a4-4cb9-84e3-d115a2c89686 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:10.059154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e5a8-85a4-4cb9-84e3-d115a2c89686 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:10.059511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e5a8-85a4-4cb9-84e3-d115a2c89686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:10.098867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f658e5a8-85a4-4cb9-84e3-d115a2c89686 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:10.099560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f658e5a8-85a4-4cb9-84e3-d115a2c89686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:10.124195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] The token cache is being invalidate because project 944ca37607d04ae29c5dd35e708cc086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:10.124718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:10.130308 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d264d67f-a2a1-4000-9f2f-26c61fde5610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:10.133216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1156/2298] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:09 2022] DELETE /identity/v3/projects/944ca37607d04ae29c5dd35e708cc086 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:42:10.141217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260c2f-68a4-43bd-a056-eba096ac5396 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:10.144164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260c2f-68a4-43bd-a056-eba096ac5396 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:10.144709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260c2f-68a4-43bd-a056-eba096ac5396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:10.231619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-3f260c2f-68a4-43bd-a056-eba096ac5396 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:10.232935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3f260c2f-68a4-43bd-a056-eba096ac5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:10.235104 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1143/2299] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:42:10.246347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1157/2300] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:10.253940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460c2e-3545-4113-bc8f-89d5d6b052a5 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:10.254696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460c2e-3545-4113-bc8f-89d5d6b052a5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:10.255293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460c2e-3545-4113-bc8f-89d5d6b052a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:10.256237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260c2f-68a4-43bd-a056-eba096ac5396 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:10.257642 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3f260c2f-68a4-43bd-a056-eba096ac5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:10.297205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-17460c2e-3545-4113-bc8f-89d5d6b052a5 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:10.300137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-17460c2e-3545-4113-bc8f-89d5d6b052a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:10.326016 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1144/2301] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:10.333380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17460c2e-3545-4113-bc8f-89d5d6b052a5 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:10.353640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17460c2e-3545-4113-bc8f-89d5d6b052a5 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:10.367437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf597ab-3d16-4c30-b6e4-be44b1809e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:10.370232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf597ab-3d16-4c30-b6e4-be44b1809e40 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:10.373070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf597ab-3d16-4c30-b6e4-be44b1809e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:10.374399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf597ab-3d16-4c30-b6e4-be44b1809e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:10.375411 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf597ab-3d16-4c30-b6e4-be44b1809e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:10.378044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf597ab-3d16-4c30-b6e4-be44b1809e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:10.384626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf597ab-3d16-4c30-b6e4-be44b1809e40 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:10.426130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1145/2302] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:42:10.426864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf597ab-3d16-4c30-b6e4-be44b1809e40 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:10.460020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf597ab-3d16-4c30-b6e4-be44b1809e40 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:10.477736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c61567-a5a4-4ad7-a421-4709345e4589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:10.478413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c61567-a5a4-4ad7-a421-4709345e4589 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:10.478808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c61567-a5a4-4ad7-a421-4709345e4589 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:10.479014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c61567-a5a4-4ad7-a421-4709345e4589 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:10.480249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c61567-a5a4-4ad7-a421-4709345e4589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:10.487847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c61567-a5a4-4ad7-a421-4709345e4589 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:10.536417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260c2f-68a4-43bd-a056-eba096ac5396 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:10.544180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca301e2-db96-4804-9545-cdc00d0eb1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:10.545147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca301e2-db96-4804-9545-cdc00d0eb1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:10.547788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca301e2-db96-4804-9545-cdc00d0eb1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:10.548354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca301e2-db96-4804-9545-cdc00d0eb1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:10.574354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca301e2-db96-4804-9545-cdc00d0eb1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:10.576168 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca301e2-db96-4804-9545-cdc00d0eb1b6 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:10.605304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1158/2303] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:42:10.633325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1146/2304] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:10 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:10.641980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca301e2-db96-4804-9545-cdc00d0eb1b6 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:10.649661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca301e2-db96-4804-9545-cdc00d0eb1b6 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:10.785486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab92bc-c427-4942-b5b9-fe06135650a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:10.786180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab92bc-c427-4942-b5b9-fe06135650a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:10.786458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab92bc-c427-4942-b5b9-fe06135650a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:10.786739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab92bc-c427-4942-b5b9-fe06135650a9 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:10.787437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab92bc-c427-4942-b5b9-fe06135650a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:10.789573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab92bc-c427-4942-b5b9-fe06135650a9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:10.911083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1159/2305] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:10 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:10.912440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c61567-a5a4-4ad7-a421-4709345e4589 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:10.928228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c61567-a5a4-4ad7-a421-4709345e4589 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:10.950458 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9d82-a01a-414e-b776-160758b27b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:10.953349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9d82-a01a-414e-b776-160758b27b03 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:10.953875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9d82-a01a-414e-b776-160758b27b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:10.954502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9d82-a01a-414e-b776-160758b27b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:10.955833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce9d82-a01a-414e-b776-160758b27b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:10.963686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce9d82-a01a-414e-b776-160758b27b03 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:10.988337 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1147/2306] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:10.992194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab92bc-c427-4942-b5b9-fe06135650a9 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:11.006733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab92bc-c427-4942-b5b9-fe06135650a9 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:11.012371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7855837-bf1b-4ddd-9c95-b9b3b6c9d63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:11.013051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7855837-bf1b-4ddd-9c95-b9b3b6c9d63e admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:11.013332 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7855837-bf1b-4ddd-9c95-b9b3b6c9d63e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:11.013611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7855837-bf1b-4ddd-9c95-b9b3b6c9d63e admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:11.014512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7855837-bf1b-4ddd-9c95-b9b3b6c9d63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:11.016043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7855837-bf1b-4ddd-9c95-b9b3b6c9d63e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:11.033800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1160/2307] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:11.034717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9d82-a01a-414e-b776-160758b27b03 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:11.050043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9d82-a01a-414e-b776-160758b27b03 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:11.061939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035b442-cc3f-44e2-bc0a-a8ecddfc5a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:11.063311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035b442-cc3f-44e2-bc0a-a8ecddfc5a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:11.064536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035b442-cc3f-44e2-bc0a-a8ecddfc5a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:11.065032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035b442-cc3f-44e2-bc0a-a8ecddfc5a9d admin admin] PATH_INFO: `/v3/projects/8dec381884a64051b0af3928caa6a1eb/users/d6e715798c4446b58cc5adeea0ef68cf/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:11.101223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035b442-cc3f-44e2-bc0a-a8ecddfc5a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dec381884a64051b0af3928caa6a1eb, user_id=d6e715798c4446b58cc5adeea0ef68cf, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:11.109060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035b442-cc3f-44e2-bc0a-a8ecddfc5a9d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:11.251997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1148/2308] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:11 2022] PUT /identity/v3/projects/8dec381884a64051b0af3928caa6a1eb/users/d6e715798c4446b58cc5adeea0ef68cf/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:11.265100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782040-5a63-4551-a3d7-891ca912ff58 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:11.265412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782040-5a63-4551-a3d7-891ca912ff58 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:11.265669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a782040-5a63-4551-a3d7-891ca912ff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:11.307361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-0a782040-5a63-4551-a3d7-891ca912ff58 None None] MFA Rules not processed for user `d6e715798c4446b58cc5adeea0ef68cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:11.309368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0a782040-5a63-4551-a3d7-891ca912ff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:11.342751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035b442-cc3f-44e2-bc0a-a8ecddfc5a9d admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:11.342751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0035b442-cc3f-44e2-bc0a-a8ecddfc5a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:11.429878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1161/2309] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:11.442879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782040-5a63-4551-a3d7-891ca912ff58 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:11.445730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0a782040-5a63-4551-a3d7-891ca912ff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:11.543444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a782040-5a63-4551-a3d7-891ca912ff58 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:11.547275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8543faa-6db5-4ecf-9512-096c34697304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:11.548196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8543faa-6db5-4ecf-9512-096c34697304 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:11.548461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8543faa-6db5-4ecf-9512-096c34697304 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:11.548743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8543faa-6db5-4ecf-9512-096c34697304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:11.559237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8543faa-6db5-4ecf-9512-096c34697304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:11.560800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8543faa-6db5-4ecf-9512-096c34697304 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:11.575105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1162/2310] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:42:11.596678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035b442-cc3f-44e2-bc0a-a8ecddfc5a9d admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:11.616329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:11.627502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:11.628761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:11.631176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:11.631836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] PATH_INFO: `/v3/projects/d5a877373ed74eabb1a9b2abadf04673` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:11.638363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a877373ed74eabb1a9b2abadf04673)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:11.640572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:11.824265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a877373ed74eabb1a9b2abadf04673', 'request_id': 'req-b6645211-bda4-4e82-b945-55efc19b761a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:11.840656 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a877373ed74eabb1a9b2abadf04673', 'request_id': 'req-b6645211-bda4-4e82-b945-55efc19b761a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:11.935188 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a877373ed74eabb1a9b2abadf04673', 'request_id': 'req-b6645211-bda4-4e82-b945-55efc19b761a'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:11.941746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:11.970719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] The token cache is being invalidate because project d5a877373ed74eabb1a9b2abadf04673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:11.970719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:11.981744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:11.984764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1149/2311] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:11 2022] DELETE /identity/v3/projects/d5a877373ed74eabb1a9b2abadf04673 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:11.988861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8543faa-6db5-4ecf-9512-096c34697304 service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:12.001943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8543faa-6db5-4ecf-9512-096c34697304 service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:12.080179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:12.081628 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:12.082156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:12.082637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] PATH_INFO: `/v3/users/899c6c461e564b798d8ef6395d69e68c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:12.084175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=899c6c461e564b798d8ef6395d69e68c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:12.086858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:12.405287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899c6c461e564b798d8ef6395d69e68c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:12.407107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899c6c461e564b798d8ef6395d69e68c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:12.415372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899c6c461e564b798d8ef6395d69e68c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:12.530108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899c6c461e564b798d8ef6395d69e68c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:12.547648 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a2dff9ac-f406-469e-b03c-6ce9623c66dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899c6c461e564b798d8ef6395d69e68c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:12.558910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1163/2312] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:11 2022] DELETE /identity/v3/users/899c6c461e564b798d8ef6395d69e68c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:13.171998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:13.179086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:13.197040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6645211-bda4-4e82-b945-55efc19b761a admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:13.296423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:13.297440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:13.297887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:13.298176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] PATH_INFO: `/v3/projects/44cb7567232341d096206d2f8774a002` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:13.300659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=44cb7567232341d096206d2f8774a002)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:13.304747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:13.474513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44cb7567232341d096206d2f8774a002', 'request_id': 'req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:13.485395 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44cb7567232341d096206d2f8774a002', 'request_id': 'req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:13.603491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44cb7567232341d096206d2f8774a002', 'request_id': 'req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:13.620007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] The token cache is being invalidate because project 44cb7567232341d096206d2f8774a002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:13.621239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:13.622230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-0f41ced3-eef7-44f6-8974-e24ea9cf4f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:13.631256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385fead-22fe-40fa-9163-e0ee19a16238 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:13.637192 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385fead-22fe-40fa-9163-e0ee19a16238 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:13.637831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385fead-22fe-40fa-9163-e0ee19a16238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:13.641450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1150/2313] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:13 2022] DELETE /identity/v3/projects/44cb7567232341d096206d2f8774a002 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:13.667996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-1385fead-22fe-40fa-9163-e0ee19a16238 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:13.669419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1385fead-22fe-40fa-9163-e0ee19a16238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:13.753019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1164/2314] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:13.764774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61840a-e71b-4ed6-a530-082d90ba55ba None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:13.765060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61840a-e71b-4ed6-a530-082d90ba55ba None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:13.765336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61840a-e71b-4ed6-a530-082d90ba55ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:13.783933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8a61840a-e71b-4ed6-a530-082d90ba55ba None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:13.785130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8a61840a-e71b-4ed6-a530-082d90ba55ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:13.798398 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1151/2315] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:13.802836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385fead-22fe-40fa-9163-e0ee19a16238 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:13.813319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385fead-22fe-40fa-9163-e0ee19a16238 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:13.818116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d54106-13e2-4195-9b3e-a1d9c80ba923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:13.875685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d54106-13e2-4195-9b3e-a1d9c80ba923 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:13.875685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d54106-13e2-4195-9b3e-a1d9c80ba923 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:13.875685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d54106-13e2-4195-9b3e-a1d9c80ba923 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:13.875685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d54106-13e2-4195-9b3e-a1d9c80ba923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:13.875685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d54106-13e2-4195-9b3e-a1d9c80ba923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:13.875685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d54106-13e2-4195-9b3e-a1d9c80ba923 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:13.876578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1165/2316] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:42:13.876962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61840a-e71b-4ed6-a530-082d90ba55ba None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:13.876962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61840a-e71b-4ed6-a530-082d90ba55ba None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:13.877742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e165f27-f208-45b6-aefc-8ebd7326376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:13.878425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165f27-f208-45b6-aefc-8ebd7326376e admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:13.878708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165f27-f208-45b6-aefc-8ebd7326376e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:13.878984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165f27-f208-45b6-aefc-8ebd7326376e admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:13.879723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e165f27-f208-45b6-aefc-8ebd7326376e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:13.881717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e165f27-f208-45b6-aefc-8ebd7326376e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:14.377892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1152/2317] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:13 2022] POST /identity/v3/projects => generated 385 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:14.381800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d54106-13e2-4195-9b3e-a1d9c80ba923 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:14.393095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d54106-13e2-4195-9b3e-a1d9c80ba923 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:14.479587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a34e0-ef01-4290-9235-634994911505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:14.480584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a34e0-ef01-4290-9235-634994911505 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:14.480972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a34e0-ef01-4290-9235-634994911505 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:14.481348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a34e0-ef01-4290-9235-634994911505 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:14.482234 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a34e0-ef01-4290-9235-634994911505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:14.484704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a34e0-ef01-4290-9235-634994911505 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:14.594284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1166/2318] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:14 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:14.598236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e165f27-f208-45b6-aefc-8ebd7326376e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:14.608679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e165f27-f208-45b6-aefc-8ebd7326376e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:14.611984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:14.614410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a28be5-27a9-493c-ab11-b843cb107531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:14.615308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28be5-27a9-493c-ab11-b843cb107531 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:14.615429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28be5-27a9-493c-ab11-b843cb107531 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:14.615773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28be5-27a9-493c-ab11-b843cb107531 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:14.616541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a28be5-27a9-493c-ab11-b843cb107531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:14.618242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a28be5-27a9-493c-ab11-b843cb107531 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:14.649127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1153/2319] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:14.650374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a34e0-ef01-4290-9235-634994911505 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:14.661640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a34e0-ef01-4290-9235-634994911505 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:14.673882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382966e-a6bb-4351-a664-7c90257d6e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:14.674568 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382966e-a6bb-4351-a664-7c90257d6e19 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:14.674861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382966e-a6bb-4351-a664-7c90257d6e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:14.675140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382966e-a6bb-4351-a664-7c90257d6e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:14.675922 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382966e-a6bb-4351-a664-7c90257d6e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:14.677750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382966e-a6bb-4351-a664-7c90257d6e19 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:14.695254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1167/2320] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:14.700235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a28be5-27a9-493c-ab11-b843cb107531 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:14.711287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a28be5-27a9-493c-ab11-b843cb107531 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:14.716825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8c73d-259b-4b89-a753-fbfa2ff3f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:14.717746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8c73d-259b-4b89-a753-fbfa2ff3f93b admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:14.718302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8c73d-259b-4b89-a753-fbfa2ff3f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:14.718591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8c73d-259b-4b89-a753-fbfa2ff3f93b admin admin] PATH_INFO: `/v3/projects/1028eb4d361142d79fbd4b9812f492fe/users/7fad1907406748b7a7916495fe09d3ff/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:14.740057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8c73d-259b-4b89-a753-fbfa2ff3f93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1028eb4d361142d79fbd4b9812f492fe, user_id=7fad1907406748b7a7916495fe09d3ff, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:14.743030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8c73d-259b-4b89-a753-fbfa2ff3f93b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:14.806196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:14.870842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1154/2321] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:14 2022] PUT /identity/v3/projects/1028eb4d361142d79fbd4b9812f492fe/users/7fad1907406748b7a7916495fe09d3ff/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:14.882230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ed8c0-1d78-4d5f-98dc-2af63263e003 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:14.882522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ed8c0-1d78-4d5f-98dc-2af63263e003 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:14.882994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ed8c0-1d78-4d5f-98dc-2af63263e003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:14.951479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-785ed8c0-1d78-4d5f-98dc-2af63263e003 None None] MFA Rules not processed for user `7fad1907406748b7a7916495fe09d3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:14.952776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-785ed8c0-1d78-4d5f-98dc-2af63263e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:15.070412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1168/2322] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:15.082231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8c73d-259b-4b89-a753-fbfa2ff3f93b admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:15.084443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8ee8c73d-259b-4b89-a753-fbfa2ff3f93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:15.185969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8c73d-259b-4b89-a753-fbfa2ff3f93b admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:15.189380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31996ba1-050a-4ed3-8f21-e01174b8d720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:15.190139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996ba1-050a-4ed3-8f21-e01174b8d720 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:15.190450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996ba1-050a-4ed3-8f21-e01174b8d720 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:15.190732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996ba1-050a-4ed3-8f21-e01174b8d720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:15.200560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31996ba1-050a-4ed3-8f21-e01174b8d720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:15.202111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31996ba1-050a-4ed3-8f21-e01174b8d720 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:15.211905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1155/2323] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:15.233199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ed8c0-1d78-4d5f-98dc-2af63263e003 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:15.334541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ed8c0-1d78-4d5f-98dc-2af63263e003 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:15.340099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:15.340960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:15.341242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:15.341518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] PATH_INFO: `/v3/users/7fad1907406748b7a7916495fe09d3ff` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:15.342719 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fad1907406748b7a7916495fe09d3ff)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:15.344673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:15.425902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:15.622385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fad1907406748b7a7916495fe09d3ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.623243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fad1907406748b7a7916495fe09d3ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.631761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fad1907406748b7a7916495fe09d3ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.710318 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fad1907406748b7a7916495fe09d3ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.723503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fad1907406748b7a7916495fe09d3ff'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.729328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1169/2324] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:15 2022] DELETE /identity/v3/users/7fad1907406748b7a7916495fe09d3ff => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:15.734078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc525-2a79-47ee-8813-aa88129e1191 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:15.734524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc525-2a79-47ee-8813-aa88129e1191 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:15.734641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc525-2a79-47ee-8813-aa88129e1191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:15.751994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-22acc525-2a79-47ee-8813-aa88129e1191 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:15.753187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-22acc525-2a79-47ee-8813-aa88129e1191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:15.814474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1156/2325] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:15.825177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:15.826550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:15.888303 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae542928-6d36-4833-b242-83b51c997a2b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:15.892412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c863b-d1bc-4d5d-9820-307fc392947f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:15.893126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c863b-d1bc-4d5d-9820-307fc392947f service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:15.893413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c863b-d1bc-4d5d-9820-307fc392947f service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:15.893694 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c863b-d1bc-4d5d-9820-307fc392947f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:15.904367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c863b-d1bc-4d5d-9820-307fc392947f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:15.905946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c863b-d1bc-4d5d-9820-307fc392947f service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:15.915880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1170/2326] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:16.363940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc525-2a79-47ee-8813-aa88129e1191 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.365443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-22acc525-2a79-47ee-8813-aa88129e1191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:16.375035 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:16.380243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc525-2a79-47ee-8813-aa88129e1191 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.386421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.387548 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.387943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.388286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] PATH_INFO: `/v3/projects/1028eb4d361142d79fbd4b9812f492fe` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.389540 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1028eb4d361142d79fbd4b9812f492fe)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.391518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.530437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1028eb4d361142d79fbd4b9812f492fe', 'request_id': 'req-2b428204-efbd-4d33-8d9c-a400819d33d6'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.537125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1028eb4d361142d79fbd4b9812f492fe', 'request_id': 'req-2b428204-efbd-4d33-8d9c-a400819d33d6'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.558645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:16.631915 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1028eb4d361142d79fbd4b9812f492fe', 'request_id': 'req-2b428204-efbd-4d33-8d9c-a400819d33d6'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.643823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] The token cache is being invalidate because project 1028eb4d361142d79fbd4b9812f492fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:16.644111 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.644756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2b428204-efbd-4d33-8d9c-a400819d33d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.646313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1157/2327] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:16 2022] DELETE /identity/v3/projects/1028eb4d361142d79fbd4b9812f492fe => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:16.651823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51861fbd-1d61-48bf-94ff-39eed7ac3e50 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.652165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51861fbd-1d61-48bf-94ff-39eed7ac3e50 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.652446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51861fbd-1d61-48bf-94ff-39eed7ac3e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.682104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-51861fbd-1d61-48bf-94ff-39eed7ac3e50 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:16.682104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-51861fbd-1d61-48bf-94ff-39eed7ac3e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:16.735835 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1171/2328] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:16.743575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570c4e4-4898-4f23-998d-fe5f9a7110a1 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.744110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570c4e4-4898-4f23-998d-fe5f9a7110a1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.744212 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570c4e4-4898-4f23-998d-fe5f9a7110a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.762742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f570c4e4-4898-4f23-998d-fe5f9a7110a1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:16.763973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f570c4e4-4898-4f23-998d-fe5f9a7110a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:16.772813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1158/2329] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:42:16.777639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51861fbd-1d61-48bf-94ff-39eed7ac3e50 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.787306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51861fbd-1d61-48bf-94ff-39eed7ac3e50 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.792016 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398aba-9484-47bc-8b5f-e6a3ee5299cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.793160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398aba-9484-47bc-8b5f-e6a3ee5299cc admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.793442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398aba-9484-47bc-8b5f-e6a3ee5299cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.793721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398aba-9484-47bc-8b5f-e6a3ee5299cc admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.794441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02398aba-9484-47bc-8b5f-e6a3ee5299cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:16.794765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02398aba-9484-47bc-8b5f-e6a3ee5299cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.796409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02398aba-9484-47bc-8b5f-e6a3ee5299cc admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.808557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1172/2330] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:42:16.812790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570c4e4-4898-4f23-998d-fe5f9a7110a1 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.822031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570c4e4-4898-4f23-998d-fe5f9a7110a1 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.827277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcc618-1124-42cf-bdf5-4c7ac73c7718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.827989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc618-1124-42cf-bdf5-4c7ac73c7718 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.828269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc618-1124-42cf-bdf5-4c7ac73c7718 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.828543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc618-1124-42cf-bdf5-4c7ac73c7718 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.829277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcc618-1124-42cf-bdf5-4c7ac73c7718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.831191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcc618-1124-42cf-bdf5-4c7ac73c7718 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.935591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1159/2331] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:16 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:16.939567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398aba-9484-47bc-8b5f-e6a3ee5299cc admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.949816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398aba-9484-47bc-8b5f-e6a3ee5299cc admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.022074 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a9af-d76b-4fe6-9ffc-d2ad0a462f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.022738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a9af-d76b-4fe6-9ffc-d2ad0a462f9b admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.027879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a9af-d76b-4fe6-9ffc-d2ad0a462f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.028424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a9af-d76b-4fe6-9ffc-d2ad0a462f9b admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.036040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5a9af-d76b-4fe6-9ffc-d2ad0a462f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.036040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5a9af-d76b-4fe6-9ffc-d2ad0a462f9b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.055246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:17.164197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1173/2332] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:16 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:17.168245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcc618-1124-42cf-bdf5-4c7ac73c7718 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.178339 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcc618-1124-42cf-bdf5-4c7ac73c7718 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.183325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cf837-d8f5-4b78-a3a5-936b0f1acb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.184028 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cf837-d8f5-4b78-a3a5-936b0f1acb91 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.184327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cf837-d8f5-4b78-a3a5-936b0f1acb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.184602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cf837-d8f5-4b78-a3a5-936b0f1acb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.185343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cf837-d8f5-4b78-a3a5-936b0f1acb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.186967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cf837-d8f5-4b78-a3a5-936b0f1acb91 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.200010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1160/2333] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:17.204359 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a9af-d76b-4fe6-9ffc-d2ad0a462f9b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.215406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a9af-d76b-4fe6-9ffc-d2ad0a462f9b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.220754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d63947-92de-45fa-a0c1-ed4f0c4e0c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.221546 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d63947-92de-45fa-a0c1-ed4f0c4e0c83 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.221831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d63947-92de-45fa-a0c1-ed4f0c4e0c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.222111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d63947-92de-45fa-a0c1-ed4f0c4e0c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.222845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d63947-92de-45fa-a0c1-ed4f0c4e0c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.224558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d63947-92de-45fa-a0c1-ed4f0c4e0c83 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.238350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1174/2334] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:17.240421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cf837-d8f5-4b78-a3a5-936b0f1acb91 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.251140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cf837-d8f5-4b78-a3a5-936b0f1acb91 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.256624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d450544-06ee-4517-981b-d0fdf57199ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.257699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d450544-06ee-4517-981b-d0fdf57199ea admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.257983 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d450544-06ee-4517-981b-d0fdf57199ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.258261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d450544-06ee-4517-981b-d0fdf57199ea admin admin] PATH_INFO: `/v3/projects/daaa6223bd3043aca778a8ad31f9b73c/users/d4ab7ee4ba6141428e267fcbb99b7e80/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.271998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:17.281796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d450544-06ee-4517-981b-d0fdf57199ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=daaa6223bd3043aca778a8ad31f9b73c, user_id=d4ab7ee4ba6141428e267fcbb99b7e80, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.284764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d450544-06ee-4517-981b-d0fdf57199ea admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.402288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1161/2335] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:17 2022] PUT /identity/v3/projects/daaa6223bd3043aca778a8ad31f9b73c/users/d4ab7ee4ba6141428e267fcbb99b7e80/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:17.413470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f59192-9a0a-49f8-9814-cfec4fec4a0c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.413782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f59192-9a0a-49f8-9814-cfec4fec4a0c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.414065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f59192-9a0a-49f8-9814-cfec4fec4a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.450182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e3f59192-9a0a-49f8-9814-cfec4fec4a0c None None] MFA Rules not processed for user `d4ab7ee4ba6141428e267fcbb99b7e80`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:17.451554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e3f59192-9a0a-49f8-9814-cfec4fec4a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:17.519309 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1175/2336] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:17.530626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d450544-06ee-4517-981b-d0fdf57199ea admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.532427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7d450544-06ee-4517-981b-d0fdf57199ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:17.591442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d450544-06ee-4517-981b-d0fdf57199ea admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.595256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8211e60-7840-4de0-b9d2-a4a250dd3774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.595969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8211e60-7840-4de0-b9d2-a4a250dd3774 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.596254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8211e60-7840-4de0-b9d2-a4a250dd3774 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.596587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8211e60-7840-4de0-b9d2-a4a250dd3774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.605199 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8211e60-7840-4de0-b9d2-a4a250dd3774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.607067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8211e60-7840-4de0-b9d2-a4a250dd3774 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.618382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1162/2337] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:18.667024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:18.843756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:19.749866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f59192-9a0a-49f8-9814-cfec4fec4a0c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:19.751415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e3f59192-9a0a-49f8-9814-cfec4fec4a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:19.821962 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f59192-9a0a-49f8-9814-cfec4fec4a0c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:19.826929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:19.828148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:19.828148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:19.828409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] PATH_INFO: `/v3/users/d6e715798c4446b58cc5adeea0ef68cf` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:19.829856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e715798c4446b58cc5adeea0ef68cf)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:19.831906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:20.019653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e715798c4446b58cc5adeea0ef68cf'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:20.020509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e715798c4446b58cc5adeea0ef68cf'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:20.048745 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e715798c4446b58cc5adeea0ef68cf'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:20.174170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e715798c4446b58cc5adeea0ef68cf'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:20.189985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e715798c4446b58cc5adeea0ef68cf'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:20.202930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1176/2338] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:19 2022] DELETE /identity/v3/users/d6e715798c4446b58cc5adeea0ef68cf => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:20.206383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b23d8-39a6-4d35-b369-b41c0ebb0b51 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:20.207356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b23d8-39a6-4d35-b369-b41c0ebb0b51 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:20.207645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b23d8-39a6-4d35-b369-b41c0ebb0b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:20.226980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b75b23d8-39a6-4d35-b369-b41c0ebb0b51 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:20.228233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b75b23d8-39a6-4d35-b369-b41c0ebb0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:20.292015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1163/2339] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:42:20.302774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:20.304237 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:20.372350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3846f1-69f7-4b22-aeab-13f6c8cc7853 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:20.378373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5882546-a8c9-44f7-99af-e0388b63febd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:20.379676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5882546-a8c9-44f7-99af-e0388b63febd service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:20.380255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5882546-a8c9-44f7-99af-e0388b63febd service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:20.380919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5882546-a8c9-44f7-99af-e0388b63febd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:20.400447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5882546-a8c9-44f7-99af-e0388b63febd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:20.402487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5882546-a8c9-44f7-99af-e0388b63febd service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:20.414123 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1177/2340] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:20.642187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:20.923357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:20.953008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b23d8-39a6-4d35-b369-b41c0ebb0b51 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:20.955206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b75b23d8-39a6-4d35-b369-b41c0ebb0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:20.971554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b23d8-39a6-4d35-b369-b41c0ebb0b51 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:20.976715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:20.981585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:20.981585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:20.981585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] PATH_INFO: `/v3/projects/8dec381884a64051b0af3928caa6a1eb` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:20.981585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dec381884a64051b0af3928caa6a1eb)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:20.981585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:21.159477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dec381884a64051b0af3928caa6a1eb', 'request_id': 'req-bfc278be-c747-4703-b2d5-42737895370f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:21.172171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dec381884a64051b0af3928caa6a1eb', 'request_id': 'req-bfc278be-c747-4703-b2d5-42737895370f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:21.258530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dec381884a64051b0af3928caa6a1eb', 'request_id': 'req-bfc278be-c747-4703-b2d5-42737895370f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:21.271594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] The token cache is being invalidate because project 8dec381884a64051b0af3928caa6a1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:21.271952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:21.272546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bfc278be-c747-4703-b2d5-42737895370f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:21.274176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1164/2341] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:20 2022] DELETE /identity/v3/projects/8dec381884a64051b0af3928caa6a1eb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:21.279143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bfcd4-efb1-49aa-b83a-4e5b713525e2 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:21.279797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bfcd4-efb1-49aa-b83a-4e5b713525e2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:21.280472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bfcd4-efb1-49aa-b83a-4e5b713525e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:21.306137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-568bfcd4-efb1-49aa-b83a-4e5b713525e2 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:21.308331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-568bfcd4-efb1-49aa-b83a-4e5b713525e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:21.368913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1178/2342] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:42:21.378576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b894f-620e-4025-b7e5-6179205d5d4e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:21.378872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b894f-620e-4025-b7e5-6179205d5d4e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:21.379157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b894f-620e-4025-b7e5-6179205d5d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:21.399892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-718b894f-620e-4025-b7e5-6179205d5d4e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:21.401032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-718b894f-620e-4025-b7e5-6179205d5d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:21.409115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1165/2343] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:21.413950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bfcd4-efb1-49aa-b83a-4e5b713525e2 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:21.424820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bfcd4-efb1-49aa-b83a-4e5b713525e2 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:21.429822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae811a-6176-424a-bf5d-a9a8ac640fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:21.430506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae811a-6176-424a-bf5d-a9a8ac640fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:21.430816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae811a-6176-424a-bf5d-a9a8ac640fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:21.431089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae811a-6176-424a-bf5d-a9a8ac640fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:21.431841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae811a-6176-424a-bf5d-a9a8ac640fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:21.432147 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae811a-6176-424a-bf5d-a9a8ac640fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:21.434317 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae811a-6176-424a-bf5d-a9a8ac640fd4 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:21.446521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1179/2344] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:42:21.451646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b894f-620e-4025-b7e5-6179205d5d4e None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:21.461272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b894f-620e-4025-b7e5-6179205d5d4e None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:21.466211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735348-e923-43ca-8185-6ae76a7d21c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:21.466861 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735348-e923-43ca-8185-6ae76a7d21c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:21.467146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735348-e923-43ca-8185-6ae76a7d21c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:21.467429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735348-e923-43ca-8185-6ae76a7d21c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:21.468151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735348-e923-43ca-8185-6ae76a7d21c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:21.470166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735348-e923-43ca-8185-6ae76a7d21c7 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:21.563960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1166/2345] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:21 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:42:21.568017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae811a-6176-424a-bf5d-a9a8ac640fd4 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:21.577994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae811a-6176-424a-bf5d-a9a8ac640fd4 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:21.635991 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9662c35-28a8-443c-8fea-95c6e6e58f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:21.636674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9662c35-28a8-443c-8fea-95c6e6e58f45 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:21.637213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9662c35-28a8-443c-8fea-95c6e6e58f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:21.637711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9662c35-28a8-443c-8fea-95c6e6e58f45 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:21.638191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9662c35-28a8-443c-8fea-95c6e6e58f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:21.640160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9662c35-28a8-443c-8fea-95c6e6e58f45 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:21.716665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1180/2346] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:21 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:42:21.720855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735348-e923-43ca-8185-6ae76a7d21c7 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:21.731753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735348-e923-43ca-8185-6ae76a7d21c7 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:21.736674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8be0f-0a6e-4ff3-8cc7-4facfb24395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:21.737341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8be0f-0a6e-4ff3-8cc7-4facfb24395b admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:21.737626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8be0f-0a6e-4ff3-8cc7-4facfb24395b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:21.737907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8be0f-0a6e-4ff3-8cc7-4facfb24395b admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:21.738642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8be0f-0a6e-4ff3-8cc7-4facfb24395b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:21.740380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8be0f-0a6e-4ff3-8cc7-4facfb24395b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:21.751308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1167/2347] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:21.758712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9662c35-28a8-443c-8fea-95c6e6e58f45 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:21.770296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9662c35-28a8-443c-8fea-95c6e6e58f45 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:21.774997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2b658-01e2-4a84-9b1c-307cc6a4de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:21.775659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b658-01e2-4a84-9b1c-307cc6a4de09 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:21.775969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b658-01e2-4a84-9b1c-307cc6a4de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:21.776954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b658-01e2-4a84-9b1c-307cc6a4de09 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:21.777678 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2b658-01e2-4a84-9b1c-307cc6a4de09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:21.779350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2b658-01e2-4a84-9b1c-307cc6a4de09 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:21.789627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1181/2348] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:21.799079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8be0f-0a6e-4ff3-8cc7-4facfb24395b admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:21.808817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8be0f-0a6e-4ff3-8cc7-4facfb24395b admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:21.813358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674fdac-83eb-4639-8120-ef671c1e943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:21.814225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674fdac-83eb-4639-8120-ef671c1e943c admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:21.814504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674fdac-83eb-4639-8120-ef671c1e943c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:21.814774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674fdac-83eb-4639-8120-ef671c1e943c admin admin] PATH_INFO: `/v3/projects/a7399873e1b14662ba8610c1b422c53e/users/595b825b71cf4ce381e68861eb7b3176/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:21.830614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674fdac-83eb-4639-8120-ef671c1e943c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7399873e1b14662ba8610c1b422c53e, user_id=595b825b71cf4ce381e68861eb7b3176, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:21.833309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674fdac-83eb-4639-8120-ef671c1e943c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:21.924823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1168/2349] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:21 2022] PUT /identity/v3/projects/a7399873e1b14662ba8610c1b422c53e/users/595b825b71cf4ce381e68861eb7b3176/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:21.935648 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36a55-7e01-4c45-a912-42ed77e83170 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:21.936053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36a55-7e01-4c45-a912-42ed77e83170 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:21.936448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36a55-7e01-4c45-a912-42ed77e83170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:21.964093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-dfe36a55-7e01-4c45-a912-42ed77e83170 None None] MFA Rules not processed for user `595b825b71cf4ce381e68861eb7b3176`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:21.965300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dfe36a55-7e01-4c45-a912-42ed77e83170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:22.030989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1182/2350] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:22.043205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674fdac-83eb-4639-8120-ef671c1e943c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:22.044413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4674fdac-83eb-4639-8120-ef671c1e943c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:22.111206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674fdac-83eb-4639-8120-ef671c1e943c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:22.115029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8b65d-bc14-4526-8801-d89d8e79ef4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24198f20ebcd4e64a5184fb9fc6764cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:22.115717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8b65d-bc14-4526-8801-d89d8e79ef4a service glance] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:22.116057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8b65d-bc14-4526-8801-d89d8e79ef4a service glance] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:22.116332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8b65d-bc14-4526-8801-d89d8e79ef4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:22.125293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8b65d-bc14-4526-8801-d89d8e79ef4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:22.126775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8b65d-bc14-4526-8801-d89d8e79ef4a service glance] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:22.138269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1169/2351] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:42:22.214971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:22.285015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36a55-7e01-4c45-a912-42ed77e83170 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:22.288979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dfe36a55-7e01-4c45-a912-42ed77e83170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:22.358088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36a55-7e01-4c45-a912-42ed77e83170 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:22.362658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:22.364456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:22.364973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:22.365482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] PATH_INFO: `/v3/users/d4ab7ee4ba6141428e267fcbb99b7e80` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:22.368492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ab7ee4ba6141428e267fcbb99b7e80)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:22.371554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:22.673128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ab7ee4ba6141428e267fcbb99b7e80'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:22.673779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ab7ee4ba6141428e267fcbb99b7e80'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:22.680686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ab7ee4ba6141428e267fcbb99b7e80'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:22.774785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ab7ee4ba6141428e267fcbb99b7e80'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:22.793782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-e260845b-2ae0-4b98-a02c-5afefc8a5a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ab7ee4ba6141428e267fcbb99b7e80'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:22.800385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1183/2352] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:22 2022] DELETE /identity/v3/users/d4ab7ee4ba6141428e267fcbb99b7e80 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:22.806080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d822e-c412-47a9-8e56-006f101c6236 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:22.806923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d822e-c412-47a9-8e56-006f101c6236 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:22.807391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d822e-c412-47a9-8e56-006f101c6236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:22.827181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-e55d822e-c412-47a9-8e56-006f101c6236 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:22.829245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e55d822e-c412-47a9-8e56-006f101c6236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:22.876083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c6d1-97d1-4c9f-b09f-c67bb3292080 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:22.876083 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c6d1-97d1-4c9f-b09f-c67bb3292080 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:22.876462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c6d1-97d1-4c9f-b09f-c67bb3292080 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:22.877786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1184/2353] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:42:22.883307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a57b93-74e4-460c-b047-52b8acc26ca5 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:22.883596 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a57b93-74e4-460c-b047-52b8acc26ca5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:22.883923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a57b93-74e4-460c-b047-52b8acc26ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:22.907940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1170/2354] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:42:22.907940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:22.914515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d822e-c412-47a9-8e56-006f101c6236 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:22.916021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e55d822e-c412-47a9-8e56-006f101c6236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:22.934110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-94a57b93-74e4-460c-b047-52b8acc26ca5 None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:22.935367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-94a57b93-74e4-460c-b047-52b8acc26ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:22.985794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d822e-c412-47a9-8e56-006f101c6236 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:22.989437 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1529978-72f7-4dd2-b8fc-a9c5065dc398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:22.990082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1529978-72f7-4dd2-b8fc-a9c5065dc398 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:22.990367 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1529978-72f7-4dd2-b8fc-a9c5065dc398 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:22.990642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1529978-72f7-4dd2-b8fc-a9c5065dc398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:23.000272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1529978-72f7-4dd2-b8fc-a9c5065dc398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:23.001880 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1529978-72f7-4dd2-b8fc-a9c5065dc398 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:23.006314 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1185/2355] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:42:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:42:23.012223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1171/2356] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:42:23.020191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a57b93-74e4-460c-b047-52b8acc26ca5 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:23.021616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-94a57b93-74e4-460c-b047-52b8acc26ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:23.087103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a57b93-74e4-460c-b047-52b8acc26ca5 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:23.094679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57650bbb-7f56-4b2e-a2e8-ab4da81c5a12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24198f20ebcd4e64a5184fb9fc6764cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:23.094679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57650bbb-7f56-4b2e-a2e8-ab4da81c5a12 service glance] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:23.094679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57650bbb-7f56-4b2e-a2e8-ab4da81c5a12 service glance] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:23.094679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57650bbb-7f56-4b2e-a2e8-ab4da81c5a12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:23.108396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57650bbb-7f56-4b2e-a2e8-ab4da81c5a12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:23.110149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57650bbb-7f56-4b2e-a2e8-ab4da81c5a12 service glance] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:23.118571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:23.135088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1186/2357] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:23.317746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:23.372966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c49f2-6293-4802-a1f0-8a1c359b4fd2 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:23.373259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c49f2-6293-4802-a1f0-8a1c359b4fd2 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:23.373541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c49f2-6293-4802-a1f0-8a1c359b4fd2 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:23.375243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1172/2358] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:42:23.381765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0a4dc-c578-4402-92da-2ad2facdf1d1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:23.382304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0a4dc-c578-4402-92da-2ad2facdf1d1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:23.382304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0a4dc-c578-4402-92da-2ad2facdf1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:23.401813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c6f0a4dc-c578-4402-92da-2ad2facdf1d1 None None] MFA Rules not processed for user `20b4902b340a4260a0b5f716c3ae9acf`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:23.403009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c6f0a4dc-c578-4402-92da-2ad2facdf1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:23.409707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1187/2359] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:42:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:23.421519 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c49f2-6293-4802-a1f0-8a1c359b4fd2 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:23.423202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f97c49f2-6293-4802-a1f0-8a1c359b4fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:23.437208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c49f2-6293-4802-a1f0-8a1c359b4fd2 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:23.440902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5684e-c95e-419f-918d-54f52d8ae526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:23.441568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5684e-c95e-419f-918d-54f52d8ae526 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:23.441876 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5684e-c95e-419f-918d-54f52d8ae526 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:23.442178 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5684e-c95e-419f-918d-54f52d8ae526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:23.450371 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5684e-c95e-419f-918d-54f52d8ae526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:23.451851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5684e-c95e-419f-918d-54f52d8ae526 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:23.460199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0a4dc-c578-4402-92da-2ad2facdf1d1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:23.461642 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c6f0a4dc-c578-4402-92da-2ad2facdf1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:23.462536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1173/2360] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:23.476329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0a4dc-c578-4402-92da-2ad2facdf1d1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:23.481336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:23.482236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:23.484756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:23.484756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] PATH_INFO: `/v3/projects/daaa6223bd3043aca778a8ad31f9b73c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:23.484756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] RBAC: Authorizing `identity:delete_project(project_id=daaa6223bd3043aca778a8ad31f9b73c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:23.486352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:23.555569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca964e73-a3ec-4f76-aa51-1259f0e2fc27 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:23.555900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca964e73-a3ec-4f76-aa51-1259f0e2fc27 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:23.556205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca964e73-a3ec-4f76-aa51-1259f0e2fc27 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:23.558157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1174/2361] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:42:23.563305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71cd08-754b-478c-b2d9-95565adcf6e8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:23.563768 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71cd08-754b-478c-b2d9-95565adcf6e8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:23.564101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71cd08-754b-478c-b2d9-95565adcf6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:23.584749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-af71cd08-754b-478c-b2d9-95565adcf6e8 None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:23.586008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-af71cd08-754b-478c-b2d9-95565adcf6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:23.587509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daaa6223bd3043aca778a8ad31f9b73c', 'request_id': 'req-c2653afc-62a0-4665-8252-82b53501027e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:23.595099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daaa6223bd3043aca778a8ad31f9b73c', 'request_id': 'req-c2653afc-62a0-4665-8252-82b53501027e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:23.605754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daaa6223bd3043aca778a8ad31f9b73c', 'request_id': 'req-c2653afc-62a0-4665-8252-82b53501027e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:23.659331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1175/2362] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:42:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:42:23.670246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71cd08-754b-478c-b2d9-95565adcf6e8 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:23.692254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] The token cache is being invalidate because project daaa6223bd3043aca778a8ad31f9b73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:23.692554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:23.693199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2653afc-62a0-4665-8252-82b53501027e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:23.694756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1188/2363] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:23 2022] DELETE /identity/v3/projects/daaa6223bd3043aca778a8ad31f9b73c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:42:23.728229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71cd08-754b-478c-b2d9-95565adcf6e8 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:23.734729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:23.735546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:23.735869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:23.736134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:23.738237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:23.760450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:23.762902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:23.774298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:23.776654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1176/2364] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:42:23.946864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:24.327503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:24.392280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:24.898963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:24.956042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:25.247944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:25.523478 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:25.860788 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:26.140665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:26.506746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:26.535267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:26.769787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:26.792549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:26.964375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:26.996301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:27.135113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:27.220954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:27.535236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:27.586834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:27.751987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:27.780539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:27.849300 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.008909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.061223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.153038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.174699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.243295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.266224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.341089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.430175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.523383 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.653489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.695214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.826895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.876405 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.087695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.112744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.306919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.338886 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.481625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.510318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.689380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.712145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.786465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.803528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.855197 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:29.906358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:30.021015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:30.139823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:30.277555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:30.311959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:30.575105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:30.624504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:30.661313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf6d5e-78b3-4544-bf29-6a88aa858be2 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:30.661597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf6d5e-78b3-4544-bf29-6a88aa858be2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:30.661877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf6d5e-78b3-4544-bf29-6a88aa858be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:30.682838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-81bf6d5e-78b3-4544-bf29-6a88aa858be2 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:30.684079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-81bf6d5e-78b3-4544-bf29-6a88aa858be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:30.740674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1189/2365] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:42:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:30.753454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:30.754846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:30.824022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860ed9-1d14-4f51-84d6-3896e80fc83f service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:30.829182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c20a03-aac9-4bf6-b184-3668d6644ad5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:30.829832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c20a03-aac9-4bf6-b184-3668d6644ad5 service swift] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:30.830116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c20a03-aac9-4bf6-b184-3668d6644ad5 service swift] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:30.830392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c20a03-aac9-4bf6-b184-3668d6644ad5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:30.838738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c20a03-aac9-4bf6-b184-3668d6644ad5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:30.840394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c20a03-aac9-4bf6-b184-3668d6644ad5 service swift] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:30.848451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1177/2366] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:42:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:42:30.921767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:30.957832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:31.060357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:31.153280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:31.238272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:31.341643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:31.381103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:31.860971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:31.912869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:32.849340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:33.077903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:33.721464 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:34.047453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:43.363344 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:44.504631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:49.707104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1db723-a0fa-490a-a40f-2c3a977bc521 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:49.707676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1db723-a0fa-490a-a40f-2c3a977bc521 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:49.707676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1db723-a0fa-490a-a40f-2c3a977bc521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:49.725209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5d1db723-a0fa-490a-a40f-2c3a977bc521 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:49.732044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5d1db723-a0fa-490a-a40f-2c3a977bc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:49.740538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1190/2367] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 16 00:42:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:49.753381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c20a03-aac9-4bf6-b184-3668d6644ad5 service swift] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:49.764734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c20a03-aac9-4bf6-b184-3668d6644ad5 service swift] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:49.769952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a303-e542-49b9-bc01-ee6d176d6734 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:49.770583 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a303-e542-49b9-bc01-ee6d176d6734 service swift] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:49.770868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a303-e542-49b9-bc01-ee6d176d6734 service swift] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:49.771146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a303-e542-49b9-bc01-ee6d176d6734 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:49.779231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a303-e542-49b9-bc01-ee6d176d6734 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:49.788488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a303-e542-49b9-bc01-ee6d176d6734 service swift] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:49.802089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1178/2368] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:42:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:42:50.001871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1db723-a0fa-490a-a40f-2c3a977bc521 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:50.003277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5d1db723-a0fa-490a-a40f-2c3a977bc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:50.069979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1db723-a0fa-490a-a40f-2c3a977bc521 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:50.074585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:50.075486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:50.075791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:50.076071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] PATH_INFO: `/v3/users/15e8b4ad668d4481a0dd656474fa11dd` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:50.077272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e8b4ad668d4481a0dd656474fa11dd)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:50.079203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:50.284665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e8b4ad668d4481a0dd656474fa11dd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:50.285330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e8b4ad668d4481a0dd656474fa11dd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:50.292624 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e8b4ad668d4481a0dd656474fa11dd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:50.448743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e8b4ad668d4481a0dd656474fa11dd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:50.461397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e8b4ad668d4481a0dd656474fa11dd'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:50.468180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1191/2369] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:50 2022] DELETE /identity/v3/users/15e8b4ad668d4481a0dd656474fa11dd => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:50.472808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b95ef-2dae-4811-a2d2-09cabe1da207 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:50.473039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b95ef-2dae-4811-a2d2-09cabe1da207 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:50.473318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b95ef-2dae-4811-a2d2-09cabe1da207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:50.491487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ae9b95ef-2dae-4811-a2d2-09cabe1da207 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:50.492813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ae9b95ef-2dae-4811-a2d2-09cabe1da207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:50.551840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1179/2370] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:50.589355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:50.589355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:50.645246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee90b11-9823-4537-b5a1-952db0e16afc admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:50.648795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898053ae-a891-4cac-a6a7-36b564246487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:50.649426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898053ae-a891-4cac-a6a7-36b564246487 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:50.649706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898053ae-a891-4cac-a6a7-36b564246487 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:50.649977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898053ae-a891-4cac-a6a7-36b564246487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:50.659386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898053ae-a891-4cac-a6a7-36b564246487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:50.660857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898053ae-a891-4cac-a6a7-36b564246487 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:50.671014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1192/2371] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:51.181317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b95ef-2dae-4811-a2d2-09cabe1da207 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:51.182786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ae9b95ef-2dae-4811-a2d2-09cabe1da207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:51.195924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b95ef-2dae-4811-a2d2-09cabe1da207 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:51.201301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:51.202174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:51.202464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:51.202743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] PATH_INFO: `/v3/projects/cc2fc4effeba4c799135e32cc302ee2a` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:51.203979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2fc4effeba4c799135e32cc302ee2a)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:51.206017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:51.315118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2fc4effeba4c799135e32cc302ee2a', 'request_id': 'req-64a75f00-0a37-4253-9da3-57177ae3c698'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:51.321438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2fc4effeba4c799135e32cc302ee2a', 'request_id': 'req-64a75f00-0a37-4253-9da3-57177ae3c698'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:51.391358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2fc4effeba4c799135e32cc302ee2a', 'request_id': 'req-64a75f00-0a37-4253-9da3-57177ae3c698'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:51.403043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] The token cache is being invalidate because project cc2fc4effeba4c799135e32cc302ee2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:51.403330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:51.407066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-64a75f00-0a37-4253-9da3-57177ae3c698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:51.407066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1180/2372] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:51 2022] DELETE /identity/v3/projects/cc2fc4effeba4c799135e32cc302ee2a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:51.410796 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6eb0f-e1eb-458b-8a81-f48a95930622 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:51.411245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6eb0f-e1eb-458b-8a81-f48a95930622 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:51.411364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6eb0f-e1eb-458b-8a81-f48a95930622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:51.429345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c3b6eb0f-e1eb-458b-8a81-f48a95930622 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:51.430562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c3b6eb0f-e1eb-458b-8a81-f48a95930622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:51.447309 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:51.488856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1193/2373] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:51.555533 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd694a06-74b1-4597-b6df-cf73b66c2a07 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:51.555850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd694a06-74b1-4597-b6df-cf73b66c2a07 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:51.556134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd694a06-74b1-4597-b6df-cf73b66c2a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:51.577687 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-cd694a06-74b1-4597-b6df-cf73b66c2a07 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:51.578926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-cd694a06-74b1-4597-b6df-cf73b66c2a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:51.587361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1181/2374] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:51.592365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6eb0f-e1eb-458b-8a81-f48a95930622 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:51.602136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6eb0f-e1eb-458b-8a81-f48a95930622 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:51.609567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df9503-f536-4e05-9584-4774b917686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:51.610280 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df9503-f536-4e05-9584-4774b917686e admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:51.610614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df9503-f536-4e05-9584-4774b917686e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:51.610897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df9503-f536-4e05-9584-4774b917686e admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:51.611645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df9503-f536-4e05-9584-4774b917686e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:51.611976 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df9503-f536-4e05-9584-4774b917686e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:51.613657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df9503-f536-4e05-9584-4774b917686e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:51.628419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1194/2375] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:42:51.633127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd694a06-74b1-4597-b6df-cf73b66c2a07 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:51.643169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd694a06-74b1-4597-b6df-cf73b66c2a07 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:51.649034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e18b02-d8cc-4c21-a14e-f9d525028925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:51.649704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e18b02-d8cc-4c21-a14e-f9d525028925 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:51.649984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e18b02-d8cc-4c21-a14e-f9d525028925 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:51.650257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e18b02-d8cc-4c21-a14e-f9d525028925 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:51.651039 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e18b02-d8cc-4c21-a14e-f9d525028925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:51.652965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e18b02-d8cc-4c21-a14e-f9d525028925 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:51.787368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1182/2376] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:51 2022] POST /identity/v3/projects => generated 397 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:42:51.791678 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df9503-f536-4e05-9584-4774b917686e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:51.801861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df9503-f536-4e05-9584-4774b917686e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:51.857873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34633898-12b9-4661-b930-6871ac9006d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:51.858465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34633898-12b9-4661-b930-6871ac9006d7 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:51.858750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34633898-12b9-4661-b930-6871ac9006d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:51.859027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34633898-12b9-4661-b930-6871ac9006d7 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:51.859763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34633898-12b9-4661-b930-6871ac9006d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:51.861814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34633898-12b9-4661-b930-6871ac9006d7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:51.968619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1195/2377] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:51 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:51.972682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e18b02-d8cc-4c21-a14e-f9d525028925 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:51.983274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e18b02-d8cc-4c21-a14e-f9d525028925 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:51.988086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ff714-fb90-4579-8e2f-50bcb36d60a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:51.988744 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ff714-fb90-4579-8e2f-50bcb36d60a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:51.989029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ff714-fb90-4579-8e2f-50bcb36d60a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:51.989305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ff714-fb90-4579-8e2f-50bcb36d60a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:51.990026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ff714-fb90-4579-8e2f-50bcb36d60a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:51.991615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ff714-fb90-4579-8e2f-50bcb36d60a5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:52.002558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1183/2378] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:52.006517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34633898-12b9-4661-b930-6871ac9006d7 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:52.017432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34633898-12b9-4661-b930-6871ac9006d7 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:52.022082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16328b-8b64-4fa6-87ba-cb3b046fc5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:52.022782 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16328b-8b64-4fa6-87ba-cb3b046fc5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:52.023006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16328b-8b64-4fa6-87ba-cb3b046fc5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:52.023281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16328b-8b64-4fa6-87ba-cb3b046fc5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:52.024025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16328b-8b64-4fa6-87ba-cb3b046fc5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:52.025639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16328b-8b64-4fa6-87ba-cb3b046fc5a1 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:52.037135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1196/2379] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:42:52.043459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ff714-fb90-4579-8e2f-50bcb36d60a5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:52.053222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ff714-fb90-4579-8e2f-50bcb36d60a5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:52.058642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b656e-8e4a-4e58-9f07-b1aa1742c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:52.059514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b656e-8e4a-4e58-9f07-b1aa1742c287 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:52.059828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b656e-8e4a-4e58-9f07-b1aa1742c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:52.060108 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b656e-8e4a-4e58-9f07-b1aa1742c287 admin admin] PATH_INFO: `/v3/projects/adc43e7b8c7647fb8fcf7881ab4bef05/users/ea5224bfba3f49da8793f093dcae6e21/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:52.076213 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b656e-8e4a-4e58-9f07-b1aa1742c287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc43e7b8c7647fb8fcf7881ab4bef05, user_id=ea5224bfba3f49da8793f093dcae6e21, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:52.078919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b656e-8e4a-4e58-9f07-b1aa1742c287 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:52.169198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1184/2380] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:52 2022] PUT /identity/v3/projects/adc43e7b8c7647fb8fcf7881ab4bef05/users/ea5224bfba3f49da8793f093dcae6e21/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:52.179258 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd3563-3e15-44fc-8cda-fba188156ee6 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:52.179545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd3563-3e15-44fc-8cda-fba188156ee6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:52.179866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd3563-3e15-44fc-8cda-fba188156ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:52.206469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-fcbd3563-3e15-44fc-8cda-fba188156ee6 None None] MFA Rules not processed for user `ea5224bfba3f49da8793f093dcae6e21`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:52.207674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fcbd3563-3e15-44fc-8cda-fba188156ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:52.270118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1197/2381] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:52.282100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b656e-8e4a-4e58-9f07-b1aa1742c287 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:52.283800 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-482b656e-8e4a-4e58-9f07-b1aa1742c287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:52.293734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:52.359888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b656e-8e4a-4e58-9f07-b1aa1742c287 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:52.363551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5b494-dbc7-4186-b7b4-31625c5cb7c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:52.364222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5b494-dbc7-4186-b7b4-31625c5cb7c3 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:52.364510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5b494-dbc7-4186-b7b4-31625c5cb7c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:52.364791 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5b494-dbc7-4186-b7b4-31625c5cb7c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:52.374006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5b494-dbc7-4186-b7b4-31625c5cb7c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:52.375433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5b494-dbc7-4186-b7b4-31625c5cb7c3 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:52.384130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1185/2382] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:57.976469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd3563-3e15-44fc-8cda-fba188156ee6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:57.978593 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fcbd3563-3e15-44fc-8cda-fba188156ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:57.985195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:58.046853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd3563-3e15-44fc-8cda-fba188156ee6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:58.051511 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:58.052419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:58.052706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:58.053063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] PATH_INFO: `/v3/users/595b825b71cf4ce381e68861eb7b3176` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:58.054251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595b825b71cf4ce381e68861eb7b3176)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:58.056255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:58.215987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595b825b71cf4ce381e68861eb7b3176'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.216587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595b825b71cf4ce381e68861eb7b3176'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.225410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595b825b71cf4ce381e68861eb7b3176'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.287723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5b494-dbc7-4186-b7b4-31625c5cb7c3 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:58.298572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5b494-dbc7-4186-b7b4-31625c5cb7c3 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:58.303114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:58.304013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:58.304384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:58.304626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] PATH_INFO: `/v3/users/ea5224bfba3f49da8793f093dcae6e21` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:58.305803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5224bfba3f49da8793f093dcae6e21)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:58.307711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:58.309236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595b825b71cf4ce381e68861eb7b3176'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.322219 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b96e61ed-e465-480d-8469-22f70d7fbee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595b825b71cf4ce381e68861eb7b3176'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.328994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1198/2383] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:57 2022] DELETE /identity/v3/users/595b825b71cf4ce381e68861eb7b3176 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:58.333257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f687ba7-77ea-46ff-9d72-65122d525e8b None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:58.333550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f687ba7-77ea-46ff-9d72-65122d525e8b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:58.333826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f687ba7-77ea-46ff-9d72-65122d525e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:58.350814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-9f687ba7-77ea-46ff-9d72-65122d525e8b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:58.352025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9f687ba7-77ea-46ff-9d72-65122d525e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:58.412077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1199/2384] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:58.421576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f687ba7-77ea-46ff-9d72-65122d525e8b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:58.422883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9f687ba7-77ea-46ff-9d72-65122d525e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:58.449743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:58.466067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5224bfba3f49da8793f093dcae6e21'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.466653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5224bfba3f49da8793f093dcae6e21'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.478686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f687ba7-77ea-46ff-9d72-65122d525e8b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:58.482391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc28193-5326-401c-ae6a-8bb649556caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:58.483210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc28193-5326-401c-ae6a-8bb649556caf service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:58.483967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc28193-5326-401c-ae6a-8bb649556caf service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:58.484295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc28193-5326-401c-ae6a-8bb649556caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:58.493230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc28193-5326-401c-ae6a-8bb649556caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:58.494657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc28193-5326-401c-ae6a-8bb649556caf service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:58.503822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1200/2385] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:42:58.532236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5224bfba3f49da8793f093dcae6e21'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.539761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5224bfba3f49da8793f093dcae6e21'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.552354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5224bfba3f49da8793f093dcae6e21'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:58.559392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1186/2386] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:58 2022] DELETE /identity/v3/users/ea5224bfba3f49da8793f093dcae6e21 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:42:58.563689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42103-f96a-44f9-9af5-8a322332f853 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:58.564034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42103-f96a-44f9-9af5-8a322332f853 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:58.564319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42103-f96a-44f9-9af5-8a322332f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:58.582660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-3ae42103-f96a-44f9-9af5-8a322332f853 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:58.583898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3ae42103-f96a-44f9-9af5-8a322332f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:58.643272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1201/2387] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:58.652770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:58.654194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:58.712848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876c816-ac63-4601-aeb6-97774112481f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:58.717119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0593b45-94f4-43e9-9582-d72374df8e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:58.717749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593b45-94f4-43e9-9582-d72374df8e05 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:58.718032 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593b45-94f4-43e9-9582-d72374df8e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:58.718341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0593b45-94f4-43e9-9582-d72374df8e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:58.730530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0593b45-94f4-43e9-9582-d72374df8e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:58.732086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0593b45-94f4-43e9-9582-d72374df8e05 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:58.742952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1187/2388] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:58.929980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42103-f96a-44f9-9af5-8a322332f853 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:58.931527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3ae42103-f96a-44f9-9af5-8a322332f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:58.944639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42103-f96a-44f9-9af5-8a322332f853 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:58.950876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:58.951846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:58.957113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:58.957440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] PATH_INFO: `/v3/projects/a7399873e1b14662ba8610c1b422c53e` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:58.958775 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7399873e1b14662ba8610c1b422c53e)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:58.961209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:59.082274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7399873e1b14662ba8610c1b422c53e', 'request_id': 'req-285278d1-9768-4e6e-b5a2-e5934afe436f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.088731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7399873e1b14662ba8610c1b422c53e', 'request_id': 'req-285278d1-9768-4e6e-b5a2-e5934afe436f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.095284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7399873e1b14662ba8610c1b422c53e', 'request_id': 'req-285278d1-9768-4e6e-b5a2-e5934afe436f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.179040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0593b45-94f4-43e9-9582-d72374df8e05 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:59.179718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] The token cache is being invalidate because project a7399873e1b14662ba8610c1b422c53e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:59.180070 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.180902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-285278d1-9768-4e6e-b5a2-e5934afe436f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.181329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e0593b45-94f4-43e9-9582-d72374df8e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:59.183296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1202/2389] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:58 2022] DELETE /identity/v3/projects/a7399873e1b14662ba8610c1b422c53e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:59.188285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cb01-cdcb-4d2f-9bcc-91559a324c81 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.188576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cb01-cdcb-4d2f-9bcc-91559a324c81 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.188854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224cb01-cdcb-4d2f-9bcc-91559a324c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.194743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:59.198895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0593b45-94f4-43e9-9582-d72374df8e05 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:59.209306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-2224cb01-cdcb-4d2f-9bcc-91559a324c81 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:59.210461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2224cb01-cdcb-4d2f-9bcc-91559a324c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:59.256516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:59.258604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:59.259533 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.259854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.260140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] PATH_INFO: `/v3/projects/adc43e7b8c7647fb8fcf7881ab4bef05` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.262370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc43e7b8c7647fb8fcf7881ab4bef05)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:59.263613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:59.271088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1203/2390] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:59.279697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483adf9-29db-4773-a8c9-1b45f1807e16 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.280021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483adf9-29db-4773-a8c9-1b45f1807e16 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.280305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483adf9-29db-4773-a8c9-1b45f1807e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.298584 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-2483adf9-29db-4773-a8c9-1b45f1807e16 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:59.300768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2483adf9-29db-4773-a8c9-1b45f1807e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:59.310916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1204/2391] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:59.315020 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483adf9-29db-4773-a8c9-1b45f1807e16 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:59.324167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483adf9-29db-4773-a8c9-1b45f1807e16 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:59.328947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a021e-14db-48ec-aeab-b4ad104be533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:59.329667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a021e-14db-48ec-aeab-b4ad104be533 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.329952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a021e-14db-48ec-aeab-b4ad104be533 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.330233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a021e-14db-48ec-aeab-b4ad104be533 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.330954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a021e-14db-48ec-aeab-b4ad104be533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:59.331264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a021e-14db-48ec-aeab-b4ad104be533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:59.332968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a021e-14db-48ec-aeab-b4ad104be533 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:59.345248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1205/2392] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:42:59.357968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a021e-14db-48ec-aeab-b4ad104be533 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:59.367989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a021e-14db-48ec-aeab-b4ad104be533 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:59.372960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075d038-45a4-4dba-a8ee-d49e434a6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:59.373604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075d038-45a4-4dba-a8ee-d49e434a6ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.373893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075d038-45a4-4dba-a8ee-d49e434a6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.374174 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075d038-45a4-4dba-a8ee-d49e434a6ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.374922 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075d038-45a4-4dba-a8ee-d49e434a6ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:59.382487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075d038-45a4-4dba-a8ee-d49e434a6ae4 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:59.395684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc43e7b8c7647fb8fcf7881ab4bef05', 'request_id': 'req-25073ceb-358f-4d09-9349-7657cc7a1669'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.402705 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc43e7b8c7647fb8fcf7881ab4bef05', 'request_id': 'req-25073ceb-358f-4d09-9349-7657cc7a1669'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.470402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1206/2393] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:59 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:59.471420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075d038-45a4-4dba-a8ee-d49e434a6ae4 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:59.488132 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc43e7b8c7647fb8fcf7881ab4bef05', 'request_id': 'req-25073ceb-358f-4d09-9349-7657cc7a1669'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.499490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] The token cache is being invalidate because project adc43e7b8c7647fb8fcf7881ab4bef05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:59.499805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.508826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:59.508826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1188/2394] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:59 2022] DELETE /identity/v3/projects/adc43e7b8c7647fb8fcf7881ab4bef05 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:59.536498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075d038-45a4-4dba-a8ee-d49e434a6ae4 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:59.541625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2211e-729b-4e89-84bc-1c56a602baae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:59.542896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2211e-729b-4e89-84bc-1c56a602baae admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.543343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2211e-729b-4e89-84bc-1c56a602baae admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.543631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2211e-729b-4e89-84bc-1c56a602baae admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.544390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2211e-729b-4e89-84bc-1c56a602baae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:59.546397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2211e-729b-4e89-84bc-1c56a602baae admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:59.630057 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1207/2395] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:59 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:42:59.631472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:59.633113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:59.703474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25073ceb-358f-4d09-9349-7657cc7a1669 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:59.708251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d389f92-2134-4105-b508-f655519b1f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:59.708923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d389f92-2134-4105-b508-f655519b1f41 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.709210 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d389f92-2134-4105-b508-f655519b1f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.709495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d389f92-2134-4105-b508-f655519b1f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.710225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d389f92-2134-4105-b508-f655519b1f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:59.711862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d389f92-2134-4105-b508-f655519b1f41 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:59.722695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1189/2396] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:59.726715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2211e-729b-4e89-84bc-1c56a602baae admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:59.737956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2211e-729b-4e89-84bc-1c56a602baae admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:59.742590 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8066-8924-45fb-a9b7-83504fb58be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:59.743236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8066-8924-45fb-a9b7-83504fb58be8 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.743517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8066-8924-45fb-a9b7-83504fb58be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.743827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8066-8924-45fb-a9b7-83504fb58be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.744543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8066-8924-45fb-a9b7-83504fb58be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:59.746130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8066-8924-45fb-a9b7-83504fb58be8 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:59.755873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1208/2397] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:59.759888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d389f92-2134-4105-b508-f655519b1f41 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:59.770408 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d389f92-2134-4105-b508-f655519b1f41 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:59.774959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81304cad-7247-4a22-a8be-2dc292c304f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:59.775855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81304cad-7247-4a22-a8be-2dc292c304f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.776143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81304cad-7247-4a22-a8be-2dc292c304f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.777128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81304cad-7247-4a22-a8be-2dc292c304f2 admin admin] PATH_INFO: `/v3/projects/0fd4466a31dd49c69849f2435e6288b2/users/16161d411fe6462cac3c1eef3818f9fe/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.791444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81304cad-7247-4a22-a8be-2dc292c304f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd4466a31dd49c69849f2435e6288b2, user_id=16161d411fe6462cac3c1eef3818f9fe, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:59.794117 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81304cad-7247-4a22-a8be-2dc292c304f2 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:59.877512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1190/2398] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:59 2022] PUT /identity/v3/projects/0fd4466a31dd49c69849f2435e6288b2/users/16161d411fe6462cac3c1eef3818f9fe/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:42:59.882452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46328299-ee00-44a7-bf3e-73b4f346677f None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:59.882743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46328299-ee00-44a7-bf3e-73b4f346677f None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:59.883050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46328299-ee00-44a7-bf3e-73b4f346677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:59.902598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-46328299-ee00-44a7-bf3e-73b4f346677f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:59.903807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-46328299-ee00-44a7-bf3e-73b4f346677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:59.962612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1209/2399] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:59.974837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81304cad-7247-4a22-a8be-2dc292c304f2 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:59.976603 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-81304cad-7247-4a22-a8be-2dc292c304f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:59.986940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:00.036612 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81304cad-7247-4a22-a8be-2dc292c304f2 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:43:00.045659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dfd2f-db8b-42bd-a617-f947a4aea55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:43:00.046453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dfd2f-db8b-42bd-a617-f947a4aea55f service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:00.046453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dfd2f-db8b-42bd-a617-f947a4aea55f service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:00.046720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dfd2f-db8b-42bd-a617-f947a4aea55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:00.056735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dfd2f-db8b-42bd-a617-f947a4aea55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:43:00.058681 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dfd2f-db8b-42bd-a617-f947a4aea55f service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:43:00.068735 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1191/2400] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:43:01.841672 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f6931-642a-470b-945d-39af9150eed3 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:01.842244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f6931-642a-470b-945d-39af9150eed3 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:01.842244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f6931-642a-470b-945d-39af9150eed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:01.881856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ba7f6931-642a-470b-945d-39af9150eed3 None None] MFA Rules not processed for user `16161d411fe6462cac3c1eef3818f9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:01.883077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ba7f6931-642a-470b-945d-39af9150eed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:01.928353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:02.011146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1210/2401] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:43:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:43:02.022867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dfd2f-db8b-42bd-a617-f947a4aea55f service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:43:02.027555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-612dfd2f-db8b-42bd-a617-f947a4aea55f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:02.106932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dfd2f-db8b-42bd-a617-f947a4aea55f service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:43:02.111382 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f94ed1-dfeb-4151-abc7-ee3b7586170c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:43:02.112173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f94ed1-dfeb-4151-abc7-ee3b7586170c service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:02.112566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f94ed1-dfeb-4151-abc7-ee3b7586170c service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:02.113000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f94ed1-dfeb-4151-abc7-ee3b7586170c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:02.128869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f94ed1-dfeb-4151-abc7-ee3b7586170c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:43:02.131223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f94ed1-dfeb-4151-abc7-ee3b7586170c service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:43:02.142626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1192/2402] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:43:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:43:04.039492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1469d0a-4aae-45ff-8586-448daf95a697 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:04.040092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1469d0a-4aae-45ff-8586-448daf95a697 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:04.040092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1469d0a-4aae-45ff-8586-448daf95a697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:04.059110 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a1469d0a-4aae-45ff-8586-448daf95a697 None None] MFA Rules not processed for user `16161d411fe6462cac3c1eef3818f9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:04.060344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a1469d0a-4aae-45ff-8586-448daf95a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:04.067392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1211/2403] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:43:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:43:06.187592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f94ed1-dfeb-4151-abc7-ee3b7586170c service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:43:06.189023 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-30f94ed1-dfeb-4151-abc7-ee3b7586170c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:06.281580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f94ed1-dfeb-4151-abc7-ee3b7586170c service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:43:06.288439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaaf5e-6c1d-402d-9d40-6e114909ab95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:43:06.289083 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaaf5e-6c1d-402d-9d40-6e114909ab95 service placement] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:06.289361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaaf5e-6c1d-402d-9d40-6e114909ab95 service placement] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:06.289636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaaf5e-6c1d-402d-9d40-6e114909ab95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:06.291385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9eeaaf5e-6c1d-402d-9d40-6e114909ab95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:06.303781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaaf5e-6c1d-402d-9d40-6e114909ab95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:43:06.305360 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaaf5e-6c1d-402d-9d40-6e114909ab95 service placement] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:43:06.315042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1193/2404] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:43:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:43:14.053487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=22 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:16.310841 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=90 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:16.535483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d378c0e-169b-47db-9f98-d4375cca29c8 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:16.535999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d378c0e-169b-47db-9f98-d4375cca29c8 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:16.537958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d378c0e-169b-47db-9f98-d4375cca29c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:16.553366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5d378c0e-169b-47db-9f98-d4375cca29c8 None None] MFA Rules not processed for user `9158887f572545039af31a513c2bc0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:16.554553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5d378c0e-169b-47db-9f98-d4375cca29c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:16.608556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1212/2405] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:43:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:43:26.601689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=25 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:27.066297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b01bf-064c-4176-894d-cb312d97a60b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:27.066858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b01bf-064c-4176-894d-cb312d97a60b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:27.066858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b01bf-064c-4176-894d-cb312d97a60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:27.086787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-062b01bf-064c-4176-894d-cb312d97a60b None None] MFA Rules not processed for user `0dd27b6f42d3412e94e582391a00474c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:27.086787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-062b01bf-064c-4176-894d-cb312d97a60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:27.148769 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1194/2406] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:43:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:43:37.141317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=25 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:41.412241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9107f-edfb-4a23-a774-f4cad4a9f054 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:41.412766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9107f-edfb-4a23-a774-f4cad4a9f054 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:41.412864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9107f-edfb-4a23-a774-f4cad4a9f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:41.431995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7eb9107f-edfb-4a23-a774-f4cad4a9f054 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:41.433307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7eb9107f-edfb-4a23-a774-f4cad4a9f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:41.441274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1213/2407] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:43:41.464359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b01bf-064c-4176-894d-cb312d97a60b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:43:41.465762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-062b01bf-064c-4176-894d-cb312d97a60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:41.566178 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b01bf-064c-4176-894d-cb312d97a60b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:43:41.571904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7e14d-5d97-4e96-9d69-2ac05f35d953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:43:41.572554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7e14d-5d97-4e96-9d69-2ac05f35d953 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:41.575518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7e14d-5d97-4e96-9d69-2ac05f35d953 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:41.575518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7e14d-5d97-4e96-9d69-2ac05f35d953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:41.582760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7e14d-5d97-4e96-9d69-2ac05f35d953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:43:41.584433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7e14d-5d97-4e96-9d69-2ac05f35d953 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:43:41.595831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1195/2408] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:43:42.517756 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98310735-ab05-4e1b-926f-b36ad3282672 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:42.518257 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98310735-ab05-4e1b-926f-b36ad3282672 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:42.518348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98310735-ab05-4e1b-926f-b36ad3282672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:42.535231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-98310735-ab05-4e1b-926f-b36ad3282672 None None] MFA Rules not processed for user `eb6d9398095c426f9d39eef485c45c66`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:42.536441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-98310735-ab05-4e1b-926f-b36ad3282672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:42.591715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1214/2409] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:43:45.733494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b168-13fd-4027-9a24-cef892c77135 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:45.734045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b168-13fd-4027-9a24-cef892c77135 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:45.734143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b168-13fd-4027-9a24-cef892c77135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:45.753933 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9ad4b168-13fd-4027-9a24-cef892c77135 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:45.755162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9ad4b168-13fd-4027-9a24-cef892c77135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:45.763390 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1196/2410] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:43:45.789162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98310735-ab05-4e1b-926f-b36ad3282672 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:43:45.790650 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-98310735-ab05-4e1b-926f-b36ad3282672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:45.807070 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98310735-ab05-4e1b-926f-b36ad3282672 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:43:45.812634 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04016195-827a-43d7-b899-550c1f0c5ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:43:45.813899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016195-827a-43d7-b899-550c1f0c5ff7 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:45.814194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016195-827a-43d7-b899-550c1f0c5ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:45.814471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016195-827a-43d7-b899-550c1f0c5ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:45.823146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04016195-827a-43d7-b899-550c1f0c5ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:43:45.824884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04016195-827a-43d7-b899-550c1f0c5ff7 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:43:45.836384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1215/2411] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:43:55.472001 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7e938-deb8-44e4-8e88-36358fbdf5cc None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:55.472545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7e938-deb8-44e4-8e88-36358fbdf5cc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:55.472545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7e938-deb8-44e4-8e88-36358fbdf5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:55.489994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-1be7e938-deb8-44e4-8e88-36358fbdf5cc None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:55.491177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1be7e938-deb8-44e4-8e88-36358fbdf5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:55.499249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1197/2412] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:43:55.534516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04016195-827a-43d7-b899-550c1f0c5ff7 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:43:55.545639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04016195-827a-43d7-b899-550c1f0c5ff7 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:43:55.551165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0a9f8-e497-40bf-9785-482989d7e832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:43:55.551812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0a9f8-e497-40bf-9785-482989d7e832 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:55.552096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0a9f8-e497-40bf-9785-482989d7e832 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:55.552371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0a9f8-e497-40bf-9785-482989d7e832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:55.560335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0a9f8-e497-40bf-9785-482989d7e832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:43:55.561905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0a9f8-e497-40bf-9785-482989d7e832 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:43:55.571718 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1216/2413] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:43:58.261967 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b54e70-c88f-47f2-aa91-55b2606c33c1 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:58.262758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b54e70-c88f-47f2-aa91-55b2606c33c1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:58.262942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b54e70-c88f-47f2-aa91-55b2606c33c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:58.280995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-66b54e70-c88f-47f2-aa91-55b2606c33c1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:58.282205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-66b54e70-c88f-47f2-aa91-55b2606c33c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:58.290227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1198/2414] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:43:58.312958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0a9f8-e497-40bf-9785-482989d7e832 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:43:58.324838 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0a9f8-e497-40bf-9785-482989d7e832 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:43:58.330220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646fdb7-0b8d-427b-9cc3-e87d6ea4a751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:43:58.331104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646fdb7-0b8d-427b-9cc3-e87d6ea4a751 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:58.331388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646fdb7-0b8d-427b-9cc3-e87d6ea4a751 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:58.331669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646fdb7-0b8d-427b-9cc3-e87d6ea4a751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:58.340608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646fdb7-0b8d-427b-9cc3-e87d6ea4a751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:43:58.343062 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646fdb7-0b8d-427b-9cc3-e87d6ea4a751 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:43:58.356195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1217/2415] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:01.529692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5efd7-689d-44be-9aab-24cc4db4141a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:01.530155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5efd7-689d-44be-9aab-24cc4db4141a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:01.530256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5efd7-689d-44be-9aab-24cc4db4141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:01.548196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b7c5efd7-689d-44be-9aab-24cc4db4141a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:01.549409 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b7c5efd7-689d-44be-9aab-24cc4db4141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:01.557995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1199/2416] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:01.583429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646fdb7-0b8d-427b-9cc3-e87d6ea4a751 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:01.594437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646fdb7-0b8d-427b-9cc3-e87d6ea4a751 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:01.600446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510a327-854c-4daf-930e-a1c7c80f6207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:01.601161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510a327-854c-4daf-930e-a1c7c80f6207 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:01.601446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510a327-854c-4daf-930e-a1c7c80f6207 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:01.601725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510a327-854c-4daf-930e-a1c7c80f6207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:01.609836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510a327-854c-4daf-930e-a1c7c80f6207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:01.611413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510a327-854c-4daf-930e-a1c7c80f6207 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:01.621393 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1218/2417] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:06.865285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb23b9-6290-460a-9b2b-dee6fde9f899 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:06.865794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb23b9-6290-460a-9b2b-dee6fde9f899 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:06.865794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb23b9-6290-460a-9b2b-dee6fde9f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:06.883147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c5fb23b9-6290-460a-9b2b-dee6fde9f899 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:06.886347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c5fb23b9-6290-460a-9b2b-dee6fde9f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:06.892464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1200/2418] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:06.914589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510a327-854c-4daf-930e-a1c7c80f6207 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:06.920379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=53 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:06.926738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510a327-854c-4daf-930e-a1c7c80f6207 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:06.932246 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccb215-1a62-43ee-a1ac-e3f2376cae4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:06.932874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccb215-1a62-43ee-a1ac-e3f2376cae4c service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:06.933161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccb215-1a62-43ee-a1ac-e3f2376cae4c service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:06.933444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccb215-1a62-43ee-a1ac-e3f2376cae4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:06.941571 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccb215-1a62-43ee-a1ac-e3f2376cae4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:06.943171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccb215-1a62-43ee-a1ac-e3f2376cae4c service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:06.953063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1219/2419] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:16.878113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=58 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:16.948886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:26.377609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79970-774a-4a0f-b50e-bdb9e6852afc None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:26.378089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79970-774a-4a0f-b50e-bdb9e6852afc None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:26.378203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79970-774a-4a0f-b50e-bdb9e6852afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:26.396412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-dfc79970-774a-4a0f-b50e-bdb9e6852afc None None] MFA Rules not processed for user `16161d411fe6462cac3c1eef3818f9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:26.397601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-dfc79970-774a-4a0f-b50e-bdb9e6852afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:26.404993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1201/2420] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:44:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:36.391128 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:38.374481 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa9c9-c87d-428e-ad74-654ce3bf363d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:38.375012 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa9c9-c87d-428e-ad74-654ce3bf363d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:38.375116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa9c9-c87d-428e-ad74-654ce3bf363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:38.393028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-feaaa9c9-c87d-428e-ad74-654ce3bf363d None None] MFA Rules not processed for user `9158887f572545039af31a513c2bc0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:38.394161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-feaaa9c9-c87d-428e-ad74-654ce3bf363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:38.401715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1220/2421] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:44:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:45.904712 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79970-774a-4a0f-b50e-bdb9e6852afc None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:45.906176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-dfc79970-774a-4a0f-b50e-bdb9e6852afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:45.922209 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79970-774a-4a0f-b50e-bdb9e6852afc None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:45.926960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:45.927970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:45.928139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:45.928417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] PATH_INFO: `/v3/users/0dd27b6f42d3412e94e582391a00474c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:45.929644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd27b6f42d3412e94e582391a00474c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:45.931756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:46.163961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd27b6f42d3412e94e582391a00474c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.164665 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd27b6f42d3412e94e582391a00474c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.212150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd27b6f42d3412e94e582391a00474c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.219172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd27b6f42d3412e94e582391a00474c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.231331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e1116e69-b50d-4a46-ab0b-49e6826f9ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd27b6f42d3412e94e582391a00474c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.237424 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1202/2422] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:44:45 2022] DELETE /identity/v3/users/0dd27b6f42d3412e94e582391a00474c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:44:46.499699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaa9c9-c87d-428e-ad74-654ce3bf363d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:46.520209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaa9c9-c87d-428e-ad74-654ce3bf363d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:46.570262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:46.571124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:46.571409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:46.571688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] PATH_INFO: `/v3/projects/8d3732c0d6e240d7bafacef301592487` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:46.572906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3732c0d6e240d7bafacef301592487)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:46.574820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:46.704685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3732c0d6e240d7bafacef301592487', 'request_id': 'req-c9f516d1-97f3-435d-a8c2-28b739489a6e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.710170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3732c0d6e240d7bafacef301592487', 'request_id': 'req-c9f516d1-97f3-435d-a8c2-28b739489a6e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.716394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3732c0d6e240d7bafacef301592487', 'request_id': 'req-c9f516d1-97f3-435d-a8c2-28b739489a6e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.789063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] The token cache is being invalidate because project 8d3732c0d6e240d7bafacef301592487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:44:46.789431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.790073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c9f516d1-97f3-435d-a8c2-28b739489a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:46.792227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1221/2423] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:44:46 2022] DELETE /identity/v3/projects/8d3732c0d6e240d7bafacef301592487 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:44:46.797234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6db32-ea3a-4930-80dc-1a2919c03c7f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:46.797530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6db32-ea3a-4930-80dc-1a2919c03c7f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:46.797809 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6db32-ea3a-4930-80dc-1a2919c03c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:46.816156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-4cf6db32-ea3a-4930-80dc-1a2919c03c7f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:46.817897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4cf6db32-ea3a-4930-80dc-1a2919c03c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:46.874722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1203/2424] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:46.882519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7dd0-ce08-403f-9a4f-9f2f53e14e8c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:46.882884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7dd0-ce08-403f-9a4f-9f2f53e14e8c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:46.883233 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7dd0-ce08-403f-9a4f-9f2f53e14e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:46.901684 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-503a7dd0-ce08-403f-9a4f-9f2f53e14e8c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:46.902876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-503a7dd0-ce08-403f-9a4f-9f2f53e14e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:46.910706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1222/2425] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:46.914593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6db32-ea3a-4930-80dc-1a2919c03c7f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:46.924495 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6db32-ea3a-4930-80dc-1a2919c03c7f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:46.929082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77589aca-a161-48d1-8800-0d0e84d4eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:46.929717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77589aca-a161-48d1-8800-0d0e84d4eb47 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:46.929997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77589aca-a161-48d1-8800-0d0e84d4eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:46.930269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77589aca-a161-48d1-8800-0d0e84d4eb47 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:46.930981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77589aca-a161-48d1-8800-0d0e84d4eb47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:44:46.931291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77589aca-a161-48d1-8800-0d0e84d4eb47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:46.933528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77589aca-a161-48d1-8800-0d0e84d4eb47 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:46.944627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1204/2426] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:44:46.948738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a7dd0-ce08-403f-9a4f-9f2f53e14e8c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:46.958133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a7dd0-ce08-403f-9a4f-9f2f53e14e8c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:46.963289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc936960-0c94-4981-a8e9-ccf846eb85c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:46.964065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc936960-0c94-4981-a8e9-ccf846eb85c2 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:46.964245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc936960-0c94-4981-a8e9-ccf846eb85c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:46.964520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc936960-0c94-4981-a8e9-ccf846eb85c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:46.965196 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc936960-0c94-4981-a8e9-ccf846eb85c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:46.967094 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc936960-0c94-4981-a8e9-ccf846eb85c2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:47.065777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1223/2427] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:44:46 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:44:47.067005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77589aca-a161-48d1-8800-0d0e84d4eb47 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:47.077924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77589aca-a161-48d1-8800-0d0e84d4eb47 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:47.135174 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19beed0-9dd9-452f-96f1-b43c04c6756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:47.135884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19beed0-9dd9-452f-96f1-b43c04c6756e admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:47.136175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19beed0-9dd9-452f-96f1-b43c04c6756e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:47.136456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19beed0-9dd9-452f-96f1-b43c04c6756e admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:47.137176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19beed0-9dd9-452f-96f1-b43c04c6756e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:47.139379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19beed0-9dd9-452f-96f1-b43c04c6756e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:47.145974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:47.232868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1205/2428] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:44:47 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:44:47.236333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc936960-0c94-4981-a8e9-ccf846eb85c2 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:47.247180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc936960-0c94-4981-a8e9-ccf846eb85c2 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:47.252035 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a73d-acd8-4243-9c5d-962c51c5f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:47.252699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a73d-acd8-4243-9c5d-962c51c5f72b admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:47.252982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a73d-acd8-4243-9c5d-962c51c5f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:47.253259 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a73d-acd8-4243-9c5d-962c51c5f72b admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:47.253980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a73d-acd8-4243-9c5d-962c51c5f72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:47.255580 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a73d-acd8-4243-9c5d-962c51c5f72b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:47.267412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1224/2429] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:44:47.271911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19beed0-9dd9-452f-96f1-b43c04c6756e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:47.285015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19beed0-9dd9-452f-96f1-b43c04c6756e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:47.291879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fda4bd-204a-4756-9ff8-8b323a78b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:47.292855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fda4bd-204a-4756-9ff8-8b323a78b6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:47.293316 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fda4bd-204a-4756-9ff8-8b323a78b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:47.293766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fda4bd-204a-4756-9ff8-8b323a78b6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:47.295499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fda4bd-204a-4756-9ff8-8b323a78b6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:47.297847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fda4bd-204a-4756-9ff8-8b323a78b6d2 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:47.309694 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1206/2430] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:44:47.313882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a73d-acd8-4243-9c5d-962c51c5f72b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:47.325988 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a73d-acd8-4243-9c5d-962c51c5f72b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:47.330776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2390bb8-a508-4a79-8920-ff65fbb2bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:47.331643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2390bb8-a508-4a79-8920-ff65fbb2bfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:47.331954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2390bb8-a508-4a79-8920-ff65fbb2bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:47.332231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2390bb8-a508-4a79-8920-ff65fbb2bfc1 admin admin] PATH_INFO: `/v3/projects/df8d39efb8ca4d968a169b22036f84c3/users/f42acc9bbc544aa78253a59f89faa94c/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:47.347557 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2390bb8-a508-4a79-8920-ff65fbb2bfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8d39efb8ca4d968a169b22036f84c3, user_id=f42acc9bbc544aa78253a59f89faa94c, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:47.350311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2390bb8-a508-4a79-8920-ff65fbb2bfc1 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:47.423421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1225/2431] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:44:47 2022] PUT /identity/v3/projects/df8d39efb8ca4d968a169b22036f84c3/users/f42acc9bbc544aa78253a59f89faa94c/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:44:47.434307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3c632-f271-400f-8bb9-c4c463aaaa5d None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:47.434307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3c632-f271-400f-8bb9-c4c463aaaa5d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:47.434307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3c632-f271-400f-8bb9-c4c463aaaa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:47.445934 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-80e3c632-f271-400f-8bb9-c4c463aaaa5d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:47.447634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-80e3c632-f271-400f-8bb9-c4c463aaaa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:47.505195 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1207/2432] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:47.516113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2390bb8-a508-4a79-8920-ff65fbb2bfc1 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:47.518263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a2390bb8-a508-4a79-8920-ff65fbb2bfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:47.542733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:47.578407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2390bb8-a508-4a79-8920-ff65fbb2bfc1 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:47.582268 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fe54c-5d53-47a7-aa9f-b5cf27a179a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:47.582977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fe54c-5d53-47a7-aa9f-b5cf27a179a4 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:47.583269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fe54c-5d53-47a7-aa9f-b5cf27a179a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:47.583547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fe54c-5d53-47a7-aa9f-b5cf27a179a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:47.594753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fe54c-5d53-47a7-aa9f-b5cf27a179a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:47.596300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fe54c-5d53-47a7-aa9f-b5cf27a179a4 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:47.609299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1226/2433] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:44:50.989024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650228c-a976-4839-af5a-262e4d14f153 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:50.989451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650228c-a976-4839-af5a-262e4d14f153 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:50.989615 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650228c-a976-4839-af5a-262e4d14f153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:51.012130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-7650228c-a976-4839-af5a-262e4d14f153 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:51.013675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7650228c-a976-4839-af5a-262e4d14f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:51.021749 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1208/2434] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:51.065854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fe54c-5d53-47a7-aa9f-b5cf27a179a4 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:51.074323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-474fe54c-5d53-47a7-aa9f-b5cf27a179a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:51.156465 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fe54c-5d53-47a7-aa9f-b5cf27a179a4 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:51.164551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc907-a07a-4b4c-95b9-90f51f3c8513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:51.166813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc907-a07a-4b4c-95b9-90f51f3c8513 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:51.167117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc907-a07a-4b4c-95b9-90f51f3c8513 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:51.167528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc907-a07a-4b4c-95b9-90f51f3c8513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:51.177622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc907-a07a-4b4c-95b9-90f51f3c8513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:51.179942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc907-a07a-4b4c-95b9-90f51f3c8513 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:51.191515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1227/2435] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:53.178308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3a0d1-86e8-4777-80e3-962b7860c712 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:53.178781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3a0d1-86e8-4777-80e3-962b7860c712 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:53.178874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3a0d1-86e8-4777-80e3-962b7860c712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:53.209322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-99a3a0d1-86e8-4777-80e3-962b7860c712 None None] MFA Rules not processed for user `f42acc9bbc544aa78253a59f89faa94c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:53.210573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-99a3a0d1-86e8-4777-80e3-962b7860c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:53.279940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1209/2436] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:44:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:44:53.294539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc907-a07a-4b4c-95b9-90f51f3c8513 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:53.306944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc907-a07a-4b4c-95b9-90f51f3c8513 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:53.312858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ec16e-cc62-44c5-a0e5-f5b2eff51375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:53.313754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ec16e-cc62-44c5-a0e5-f5b2eff51375 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:53.314042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ec16e-cc62-44c5-a0e5-f5b2eff51375 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:53.314323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ec16e-cc62-44c5-a0e5-f5b2eff51375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:53.323027 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ec16e-cc62-44c5-a0e5-f5b2eff51375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:53.324730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ec16e-cc62-44c5-a0e5-f5b2eff51375 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:53.334820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1228/2437] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:54.686372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268bebf-fbcd-4498-b1fd-e9aca562c819 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:54.686868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268bebf-fbcd-4498-b1fd-e9aca562c819 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:54.687151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268bebf-fbcd-4498-b1fd-e9aca562c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:54.706641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c268bebf-fbcd-4498-b1fd-e9aca562c819 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:54.708051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c268bebf-fbcd-4498-b1fd-e9aca562c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:54.717299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1210/2438] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:54.744063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ec16e-cc62-44c5-a0e5-f5b2eff51375 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:54.745609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-723ec16e-cc62-44c5-a0e5-f5b2eff51375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:54.762177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ec16e-cc62-44c5-a0e5-f5b2eff51375 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:54.768084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577c434-b048-46ec-964a-7d287842f35e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:54.768725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577c434-b048-46ec-964a-7d287842f35e service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:54.769011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577c434-b048-46ec-964a-7d287842f35e service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:54.769290 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577c434-b048-46ec-964a-7d287842f35e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:54.777679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577c434-b048-46ec-964a-7d287842f35e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:54.779276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577c434-b048-46ec-964a-7d287842f35e service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:54.789411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1229/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:56.262925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4790e-a177-4a2b-b008-695b94585497 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:56.263780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4790e-a177-4a2b-b008-695b94585497 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:56.264071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4790e-a177-4a2b-b008-695b94585497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:56.284109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ded4790e-a177-4a2b-b008-695b94585497 None None] MFA Rules not processed for user `f42acc9bbc544aa78253a59f89faa94c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:56.287956 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ded4790e-a177-4a2b-b008-695b94585497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:56.293027 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1211/2440] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:44:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:57.553676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f8094-6d89-4391-bd3f-3e1df3932be0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:57.554200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f8094-6d89-4391-bd3f-3e1df3932be0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:57.554310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f8094-6d89-4391-bd3f-3e1df3932be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:57.576839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ec0f8094-6d89-4391-bd3f-3e1df3932be0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:57.579254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ec0f8094-6d89-4391-bd3f-3e1df3932be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:57.596374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1230/2441] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:57.619862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4790e-a177-4a2b-b008-695b94585497 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:57.634728 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4790e-a177-4a2b-b008-695b94585497 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:57.642938 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d091f19-b56a-43c4-bffd-79fced3999f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:57.643686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d091f19-b56a-43c4-bffd-79fced3999f9 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:57.644134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d091f19-b56a-43c4-bffd-79fced3999f9 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:57.644484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d091f19-b56a-43c4-bffd-79fced3999f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:57.656137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d091f19-b56a-43c4-bffd-79fced3999f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:57.657732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a3de-b38c-4993-8b2c-0d8f547e62b1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:57.658118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a3de-b38c-4993-8b2c-0d8f547e62b1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:57.658489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a3de-b38c-4993-8b2c-0d8f547e62b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:57.659077 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d091f19-b56a-43c4-bffd-79fced3999f9 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:57.672047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1212/2442] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:57.733944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a028a3de-b38c-4993-8b2c-0d8f547e62b1 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:57.735407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a028a3de-b38c-4993-8b2c-0d8f547e62b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:57.823886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:57.870170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1231/2443] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:44:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:44:58.017767 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d091f19-b56a-43c4-bffd-79fced3999f9 service nova] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:58.019279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5d091f19-b56a-43c4-bffd-79fced3999f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:58.087356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:58.142256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d091f19-b56a-43c4-bffd-79fced3999f9 service nova] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:58.148177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6679bff-36ea-4151-abc8-ff58c1149cb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:58.148912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6679bff-36ea-4151-abc8-ff58c1149cb9 service swift] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:58.149274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6679bff-36ea-4151-abc8-ff58c1149cb9 service swift] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:58.149696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6679bff-36ea-4151-abc8-ff58c1149cb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:58.159193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6679bff-36ea-4151-abc8-ff58c1149cb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:58.160935 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6679bff-36ea-4151-abc8-ff58c1149cb9 service swift] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:58.170507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1213/2444] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:45:00.881534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed5518-1a2f-437b-8502-409fc61ac616 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:00.882399 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed5518-1a2f-437b-8502-409fc61ac616 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:00.882841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed5518-1a2f-437b-8502-409fc61ac616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:00.903472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-35ed5518-1a2f-437b-8502-409fc61ac616 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:00.905073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-35ed5518-1a2f-437b-8502-409fc61ac616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:00.917294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1232/2445] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:45:00.939290 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6679bff-36ea-4151-abc8-ff58c1149cb9 service swift] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:00.956145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6679bff-36ea-4151-abc8-ff58c1149cb9 service swift] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:00.964515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598e84-8261-48c1-92c0-566bc7216665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:00.966508 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598e84-8261-48c1-92c0-566bc7216665 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:00.967038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598e84-8261-48c1-92c0-566bc7216665 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:00.967474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da598e84-8261-48c1-92c0-566bc7216665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:00.980145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da598e84-8261-48c1-92c0-566bc7216665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:00.981997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da598e84-8261-48c1-92c0-566bc7216665 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:00.999374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1214/2446] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:02.852870 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed5518-1a2f-437b-8502-409fc61ac616 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:02.863570 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed5518-1a2f-437b-8502-409fc61ac616 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:02.869203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254fe80-1c26-486f-84cb-e6f0b8f69b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:02.869853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254fe80-1c26-486f-84cb-e6f0b8f69b80 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:02.870138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254fe80-1c26-486f-84cb-e6f0b8f69b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:02.870417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254fe80-1c26-486f-84cb-e6f0b8f69b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:02.872433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5254fe80-1c26-486f-84cb-e6f0b8f69b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:02.893696 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254fe80-1c26-486f-84cb-e6f0b8f69b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:02.895028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254fe80-1c26-486f-84cb-e6f0b8f69b80 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:02.917398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1233/2447] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:04.636473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598e84-8261-48c1-92c0-566bc7216665 service nova] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:04.638307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-da598e84-8261-48c1-92c0-566bc7216665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:04.652338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da598e84-8261-48c1-92c0-566bc7216665 service nova] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:04.656046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cc2e1-a7a5-45e0-8613-2703f31394bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:04.656704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cc2e1-a7a5-45e0-8613-2703f31394bb service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:04.656997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cc2e1-a7a5-45e0-8613-2703f31394bb service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:04.657275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cc2e1-a7a5-45e0-8613-2703f31394bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:04.659530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-480cc2e1-a7a5-45e0-8613-2703f31394bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:04.674862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cc2e1-a7a5-45e0-8613-2703f31394bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:04.676332 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cc2e1-a7a5-45e0-8613-2703f31394bb service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:04.690232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1215/2448] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:05.408441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcab19-9025-4037-9e61-120eb06295db None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:05.408925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcab19-9025-4037-9e61-120eb06295db None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:05.409017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcab19-9025-4037-9e61-120eb06295db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:05.427099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-1abcab19-9025-4037-9e61-120eb06295db None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:05.428313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1abcab19-9025-4037-9e61-120eb06295db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:05.436776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1234/2449] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Jun 16 00:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:45:05.457961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cc2e1-a7a5-45e0-8613-2703f31394bb service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:05.469466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cc2e1-a7a5-45e0-8613-2703f31394bb service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:05.475121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05129d-838a-40b3-a1ea-afba32821dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:05.475804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05129d-838a-40b3-a1ea-afba32821dc6 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:05.476073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05129d-838a-40b3-a1ea-afba32821dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:05.476423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05129d-838a-40b3-a1ea-afba32821dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:05.486867 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05129d-838a-40b3-a1ea-afba32821dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:05.488498 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05129d-838a-40b3-a1ea-afba32821dc6 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:05.501099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1216/2450] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:05.661452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcab19-9025-4037-9e61-120eb06295db None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:05.673933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcab19-9025-4037-9e61-120eb06295db None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:05.677746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a8fab-8ba9-428d-89c0-616c9829aa7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:05.678461 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a8fab-8ba9-428d-89c0-616c9829aa7c service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:05.678815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a8fab-8ba9-428d-89c0-616c9829aa7c service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:05.679324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a8fab-8ba9-428d-89c0-616c9829aa7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:05.681931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1b9a8fab-8ba9-428d-89c0-616c9829aa7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:05.752572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a8fab-8ba9-428d-89c0-616c9829aa7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:05.754360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a8fab-8ba9-428d-89c0-616c9829aa7c service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:05.764658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1235/2451] 10.222.0.27 () {60 vars in 1396 bytes} [Thu Jun 16 00:45:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:15.494970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=43 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:15.759520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=46 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:21.892275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05129d-838a-40b3-a1ea-afba32821dc6 service nova] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:21.902207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05129d-838a-40b3-a1ea-afba32821dc6 service nova] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:21.905851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449034ca-8a84-4dbd-86b3-182a670739e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:21.906511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449034ca-8a84-4dbd-86b3-182a670739e6 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:21.906829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449034ca-8a84-4dbd-86b3-182a670739e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:21.907110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449034ca-8a84-4dbd-86b3-182a670739e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:21.908897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-449034ca-8a84-4dbd-86b3-182a670739e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:21.919062 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449034ca-8a84-4dbd-86b3-182a670739e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:21.920504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449034ca-8a84-4dbd-86b3-182a670739e6 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:21.928418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1217/2452] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:22.298747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fa9b0-6fe6-4002-9b40-e3fa865325d6 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:22.298747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fa9b0-6fe6-4002-9b40-e3fa865325d6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:22.298747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fa9b0-6fe6-4002-9b40-e3fa865325d6 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:22.300051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1236/2453] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:45:22.305281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f6c0f-ec0d-4527-a09f-bc2ab3d34eec None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:22.305728 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f6c0f-ec0d-4527-a09f-bc2ab3d34eec None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:22.306580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f6c0f-ec0d-4527-a09f-bc2ab3d34eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:22.349177 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ce3f6c0f-ec0d-4527-a09f-bc2ab3d34eec None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:22.350443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ce3f6c0f-ec0d-4527-a09f-bc2ab3d34eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:22.359995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1218/2454] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:45:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:45:22.371791 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fa9b0-6fe6-4002-9b40-e3fa865325d6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:22.373459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-156fa9b0-6fe6-4002-9b40-e3fa865325d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:22.451777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fa9b0-6fe6-4002-9b40-e3fa865325d6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:22.456414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29287e3-b7d6-4053-821f-4f669fe2032c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24198f20ebcd4e64a5184fb9fc6764cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:22.457045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29287e3-b7d6-4053-821f-4f669fe2032c service glance] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:22.457330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29287e3-b7d6-4053-821f-4f669fe2032c service glance] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:22.457611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29287e3-b7d6-4053-821f-4f669fe2032c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:22.468368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29287e3-b7d6-4053-821f-4f669fe2032c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:22.469795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29287e3-b7d6-4053-821f-4f669fe2032c service glance] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:22.480816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1237/2455] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:22.768292 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f3f20-bd4c-41f0-92f9-cd44a98e4c37 None None] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:22.768583 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f3f20-bd4c-41f0-92f9-cd44a98e4c37 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:22.768887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f3f20-bd4c-41f0-92f9-cd44a98e4c37 None None] PATH_INFO: `/` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:22.770282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1219/2456] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:45:22.775689 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547fd5b-e6db-4feb-85a3-e5b92018f98e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:22.776010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547fd5b-e6db-4feb-85a3-e5b92018f98e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:22.776321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547fd5b-e6db-4feb-85a3-e5b92018f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:22.795900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-0547fd5b-e6db-4feb-85a3-e5b92018f98e None None] MFA Rules not processed for user `20b4902b340a4260a0b5f716c3ae9acf`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:22.797088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0547fd5b-e6db-4feb-85a3-e5b92018f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:22.803660 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1238/2457] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:45:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:45:22.815757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f3f20-bd4c-41f0-92f9-cd44a98e4c37 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:22.826529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f3f20-bd4c-41f0-92f9-cd44a98e4c37 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:22.829993 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f516f-5840-4ee7-a5f1-053aaa25b3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:22.830617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f516f-5840-4ee7-a5f1-053aaa25b3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:22.830900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f516f-5840-4ee7-a5f1-053aaa25b3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:22.831175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f516f-5840-4ee7-a5f1-053aaa25b3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:22.838126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f516f-5840-4ee7-a5f1-053aaa25b3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:22.839535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f516f-5840-4ee7-a5f1-053aaa25b3d5 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:22.847068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1220/2458] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:22.929067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bba17-4809-4953-b0f1-c7cc23cc1057 None None] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:22.929360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bba17-4809-4953-b0f1-c7cc23cc1057 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:22.929668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bba17-4809-4953-b0f1-c7cc23cc1057 None None] PATH_INFO: `/` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:22.931089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1239/2459] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 16 00:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:45:22.936432 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dca254-dffd-4727-ae68-09dfba2525c0 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:22.936870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dca254-dffd-4727-ae68-09dfba2525c0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:22.936982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dca254-dffd-4727-ae68-09dfba2525c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:22.955539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f3dca254-dffd-4727-ae68-09dfba2525c0 None None] MFA Rules not processed for user `ba29f9c029fe4390af3b6ce1b2147ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:22.956758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f3dca254-dffd-4727-ae68-09dfba2525c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:22.966987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1221/2460] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 16 00:45:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:45:22.977595 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bba17-4809-4953-b0f1-c7cc23cc1057 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:22.989180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bba17-4809-4953-b0f1-c7cc23cc1057 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:22.992972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50384799-b0a9-4c80-94c8-d98882cd622f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:22.993665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384799-b0a9-4c80-94c8-d98882cd622f service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:22.993949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384799-b0a9-4c80-94c8-d98882cd622f service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:22.994230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50384799-b0a9-4c80-94c8-d98882cd622f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:23.004508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384799-b0a9-4c80-94c8-d98882cd622f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:23.005956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50384799-b0a9-4c80-94c8-d98882cd622f service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:23.016778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1240/2461] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:23.077851 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dca254-dffd-4727-ae68-09dfba2525c0 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:23.079244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f3dca254-dffd-4727-ae68-09dfba2525c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:23.146927 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dca254-dffd-4727-ae68-09dfba2525c0 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:23.152002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef221ddf-ea20-4a85-8c1d-c7c9d99827d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:23.153820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef221ddf-ea20-4a85-8c1d-c7c9d99827d6 service placement] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:23.153820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef221ddf-ea20-4a85-8c1d-c7c9d99827d6 service placement] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:23.153820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef221ddf-ea20-4a85-8c1d-c7c9d99827d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:23.157450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ef221ddf-ea20-4a85-8c1d-c7c9d99827d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:23.167118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef221ddf-ea20-4a85-8c1d-c7c9d99827d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:23.168742 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef221ddf-ea20-4a85-8c1d-c7c9d99827d6 service placement] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:23.178763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1222/2462] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:25.678097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ed196-652a-43ee-b81a-5f79786d0cd7 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:25.678560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ed196-652a-43ee-b81a-5f79786d0cd7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:25.678674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ed196-652a-43ee-b81a-5f79786d0cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:25.696164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-aa0ed196-652a-43ee-b81a-5f79786d0cd7 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:25.697863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-aa0ed196-652a-43ee-b81a-5f79786d0cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:25.705375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1241/2463] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:45:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:45:25.717910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef221ddf-ea20-4a85-8c1d-c7c9d99827d6 service placement] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:25.728864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef221ddf-ea20-4a85-8c1d-c7c9d99827d6 service placement] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:25.733904 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00789f-99a0-4d3b-847d-0a9a64295e61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:25.734542 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00789f-99a0-4d3b-847d-0a9a64295e61 service swift] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:25.734823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00789f-99a0-4d3b-847d-0a9a64295e61 service swift] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:25.735101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00789f-99a0-4d3b-847d-0a9a64295e61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:25.745907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00789f-99a0-4d3b-847d-0a9a64295e61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:25.745907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00789f-99a0-4d3b-847d-0a9a64295e61 service swift] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:25.753547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1223/2464] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:45:33.891808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ed196-652a-43ee-b81a-5f79786d0cd7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:33.906586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ed196-652a-43ee-b81a-5f79786d0cd7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:33.922547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039539-721a-43f4-8ce6-739273de0197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:33.923487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039539-721a-43f4-8ce6-739273de0197 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:33.923700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039539-721a-43f4-8ce6-739273de0197 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:33.928367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039539-721a-43f4-8ce6-739273de0197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:33.928367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-57039539-721a-43f4-8ce6-739273de0197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:33.996629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039539-721a-43f4-8ce6-739273de0197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:33.998245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039539-721a-43f4-8ce6-739273de0197 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:34.007818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1242/2465] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:35.750249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=62 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:41.931693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00789f-99a0-4d3b-847d-0a9a64295e61 service swift] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:41.948783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00789f-99a0-4d3b-847d-0a9a64295e61 service swift] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:41.954289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:41.954936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:41.955222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:41.955505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:41.957362 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:41.970310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:41.971837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:41.983105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1224/2466] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:42.782983 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039539-721a-43f4-8ce6-739273de0197 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:42.793207 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039539-721a-43f4-8ce6-739273de0197 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:42.796917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f20b4-1097-4f74-a51f-7933de6a4ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:42.797637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f20b4-1097-4f74-a51f-7933de6a4ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:42.798008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f20b4-1097-4f74-a51f-7933de6a4ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:42.798498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f20b4-1097-4f74-a51f-7933de6a4ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:42.800486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fe3f20b4-1097-4f74-a51f-7933de6a4ce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:42.811263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f20b4-1097-4f74-a51f-7933de6a4ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:42.812744 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f20b4-1097-4f74-a51f-7933de6a4ce5 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:42.821960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1243/2467] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:43.008572 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:43.010575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:43.025919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22340f-3b54-42f9-98da-951b70c3154f service nova] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:43.031349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:43.032344 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:43.032627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:43.032858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] PATH_INFO: `/v3/users/16161d411fe6462cac3c1eef3818f9fe` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:43.034108 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16161d411fe6462cac3c1eef3818f9fe)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:43.039866 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:43.250381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16161d411fe6462cac3c1eef3818f9fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.251089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16161d411fe6462cac3c1eef3818f9fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.322723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16161d411fe6462cac3c1eef3818f9fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.329891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16161d411fe6462cac3c1eef3818f9fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.342013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e14651d1-807d-4877-8932-746556d76f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16161d411fe6462cac3c1eef3818f9fe'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.348008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1225/2468] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:45:43 2022] DELETE /identity/v3/users/16161d411fe6462cac3c1eef3818f9fe => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:45:43.581890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f20b4-1097-4f74-a51f-7933de6a4ce5 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:43.602222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f20b4-1097-4f74-a51f-7933de6a4ce5 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:43.650858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:43.670361 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:43.671219 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:43.671616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:43.671927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] PATH_INFO: `/v3/projects/0fd4466a31dd49c69849f2435e6288b2` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:43.673427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd4466a31dd49c69849f2435e6288b2)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:43.675333 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:43.825255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd4466a31dd49c69849f2435e6288b2', 'request_id': 'req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.830588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd4466a31dd49c69849f2435e6288b2', 'request_id': 'req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.836589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd4466a31dd49c69849f2435e6288b2', 'request_id': 'req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.919553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] The token cache is being invalidate because project 0fd4466a31dd49c69849f2435e6288b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:45:43.919873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.920485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:43.922032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1244/2469] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:45:43 2022] DELETE /identity/v3/projects/0fd4466a31dd49c69849f2435e6288b2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:45:44.052582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0fb55-338a-46d7-8dd8-d5e16b2a17de None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:44.053133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0fb55-338a-46d7-8dd8-d5e16b2a17de None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:44.053364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0fb55-338a-46d7-8dd8-d5e16b2a17de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:44.073071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-70f0fb55-338a-46d7-8dd8-d5e16b2a17de None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:44.074700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-70f0fb55-338a-46d7-8dd8-d5e16b2a17de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:44.142305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1226/2470] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 16 00:45:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:45:44.155692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:44.157177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:44.225379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d4ed6-40bd-4a75-a69d-19019c085cbe admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:44.231231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66fe5a-795e-4668-97e8-59b0a160a8e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:44.231972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66fe5a-795e-4668-97e8-59b0a160a8e8 service swift] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:44.232253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66fe5a-795e-4668-97e8-59b0a160a8e8 service swift] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:44.232526 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66fe5a-795e-4668-97e8-59b0a160a8e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:44.240676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66fe5a-795e-4668-97e8-59b0a160a8e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:44.242245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66fe5a-795e-4668-97e8-59b0a160a8e8 service swift] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:44.251378 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1245/2471] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:45:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:45:47.110771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0fb55-338a-46d7-8dd8-d5e16b2a17de None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:47.112298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-70f0fb55-338a-46d7-8dd8-d5e16b2a17de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:47.206206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:47.214731 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0fb55-338a-46d7-8dd8-d5e16b2a17de None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:47.220891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:47.221556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:47.221840 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:47.222122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:47.224862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:47.241417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:47.243134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:47.257707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1227/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:53.739880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66fe5a-795e-4668-97e8-59b0a160a8e8 service swift] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:53.741285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dd66fe5a-795e-4668-97e8-59b0a160a8e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:53.797871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66fe5a-795e-4668-97e8-59b0a160a8e8 service swift] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:53.801499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:53.802135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:53.802412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:53.802685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:53.804410 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:53.817908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:53.865513 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:53.866959 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:53.876577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1246/2473] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:57.244114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:57.245539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:57.317522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aaaeb-465c-4dfe-8a9b-12e4b4019bdf service nova] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:57.322609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9601229-d689-4f34-b78a-5ed47682327c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:57.323244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9601229-d689-4f34-b78a-5ed47682327c service placement] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:57.323526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9601229-d689-4f34-b78a-5ed47682327c service placement] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:57.323837 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9601229-d689-4f34-b78a-5ed47682327c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:57.325623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c9601229-d689-4f34-b78a-5ed47682327c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:57.336885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9601229-d689-4f34-b78a-5ed47682327c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:57.341228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9601229-d689-4f34-b78a-5ed47682327c service placement] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:57.348374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1228/2474] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:57.380418 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:57.381868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:57.399665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7fe9f-3baf-4c83-8184-24ea42f18abe service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:57.404539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:57.405453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:57.405735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:57.406037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] PATH_INFO: `/v3/users/9158887f572545039af31a513c2bc0f1` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:57.407232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9158887f572545039af31a513c2bc0f1)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:57.409273 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:57.586573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9158887f572545039af31a513c2bc0f1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:57.587231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9158887f572545039af31a513c2bc0f1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:57.594154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9158887f572545039af31a513c2bc0f1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:57.659665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9158887f572545039af31a513c2bc0f1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:57.672119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-094e8689-56b3-400b-8bbd-9ecc0e5d8d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9158887f572545039af31a513c2bc0f1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:57.678675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1247/2475] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:45:57 2022] DELETE /identity/v3/users/9158887f572545039af31a513c2bc0f1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:45:57.918343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9601229-d689-4f34-b78a-5ed47682327c service placement] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:57.929814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9601229-d689-4f34-b78a-5ed47682327c service placement] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:57.987031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:57.987970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:57.988252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:57.988524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] PATH_INFO: `/v3/projects/66d87b8e7af54b9dbb089b8a54716a7c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:57.989684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d87b8e7af54b9dbb089b8a54716a7c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:57.991628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:58.094425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d87b8e7af54b9dbb089b8a54716a7c', 'request_id': 'req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:58.101187 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d87b8e7af54b9dbb089b8a54716a7c', 'request_id': 'req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:58.165357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d87b8e7af54b9dbb089b8a54716a7c', 'request_id': 'req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:58.178017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] The token cache is being invalidate because project 66d87b8e7af54b9dbb089b8a54716a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:45:58.178362 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:58.179010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ae2bdaf8-f86c-41aa-b09a-a7de05a4d11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:45:58.180697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1229/2476] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:45:57 2022] DELETE /identity/v3/projects/66d87b8e7af54b9dbb089b8a54716a7c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:45:58.185641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde77ac-286b-410e-b1d6-54eba9f2d7a7 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:58.186015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde77ac-286b-410e-b1d6-54eba9f2d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:58.186440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde77ac-286b-410e-b1d6-54eba9f2d7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:58.204009 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-8bde77ac-286b-410e-b1d6-54eba9f2d7a7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:58.205806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8bde77ac-286b-410e-b1d6-54eba9f2d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:58.265156 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1248/2477] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:45:58.273831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1503658-d814-414e-bbf4-8c9ef6536d11 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:58.274302 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1503658-d814-414e-bbf4-8c9ef6536d11 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:58.274422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1503658-d814-414e-bbf4-8c9ef6536d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:58.292699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-d1503658-d814-414e-bbf4-8c9ef6536d11 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:58.293883 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d1503658-d814-414e-bbf4-8c9ef6536d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:58.301656 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1230/2478] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:45:58.305686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde77ac-286b-410e-b1d6-54eba9f2d7a7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:58.315716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde77ac-286b-410e-b1d6-54eba9f2d7a7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:58.320232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea172ddf-69fc-43cc-99b5-e700bcb98db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:58.320879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea172ddf-69fc-43cc-99b5-e700bcb98db5 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:58.321165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea172ddf-69fc-43cc-99b5-e700bcb98db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:58.321446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea172ddf-69fc-43cc-99b5-e700bcb98db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:58.322159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea172ddf-69fc-43cc-99b5-e700bcb98db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:45:58.322467 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea172ddf-69fc-43cc-99b5-e700bcb98db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:58.324128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea172ddf-69fc-43cc-99b5-e700bcb98db5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:58.336049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1249/2479] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:45:58.340316 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1503658-d814-414e-bbf4-8c9ef6536d11 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:58.344649 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:58.349839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1503658-d814-414e-bbf4-8c9ef6536d11 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:58.354714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21449f-fa69-4000-bf51-072cc64307d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:58.355355 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21449f-fa69-4000-bf51-072cc64307d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:58.355638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21449f-fa69-4000-bf51-072cc64307d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:58.355949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21449f-fa69-4000-bf51-072cc64307d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:58.356638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21449f-fa69-4000-bf51-072cc64307d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:58.358602 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21449f-fa69-4000-bf51-072cc64307d0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:58.459081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1231/2480] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:45:58 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:45:58.462998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea172ddf-69fc-43cc-99b5-e700bcb98db5 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:58.472899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea172ddf-69fc-43cc-99b5-e700bcb98db5 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:58.480616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:58.529104 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729750b-0e55-4f89-bddb-3999c9269626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:58.529759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729750b-0e55-4f89-bddb-3999c9269626 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:58.530047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729750b-0e55-4f89-bddb-3999c9269626 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:58.530329 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729750b-0e55-4f89-bddb-3999c9269626 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:58.531001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729750b-0e55-4f89-bddb-3999c9269626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:58.532953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729750b-0e55-4f89-bddb-3999c9269626 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:58.613102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1250/2481] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:45:58 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:45:58.617522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21449f-fa69-4000-bf51-072cc64307d0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:58.628208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21449f-fa69-4000-bf51-072cc64307d0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:58.632871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176e0d-bc39-4c1e-8673-9aa26614b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:58.633514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176e0d-bc39-4c1e-8673-9aa26614b765 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:58.633793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176e0d-bc39-4c1e-8673-9aa26614b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:58.634072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176e0d-bc39-4c1e-8673-9aa26614b765 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:58.636042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a176e0d-bc39-4c1e-8673-9aa26614b765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:58.636463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a176e0d-bc39-4c1e-8673-9aa26614b765 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:58.647768 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1232/2482] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:45:58.651651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729750b-0e55-4f89-bddb-3999c9269626 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:58.661827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729750b-0e55-4f89-bddb-3999c9269626 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:58.666463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637bbc1-070a-44aa-9636-61fe9f43674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:58.667121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637bbc1-070a-44aa-9636-61fe9f43674d admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:58.667412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637bbc1-070a-44aa-9636-61fe9f43674d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:58.667692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637bbc1-070a-44aa-9636-61fe9f43674d admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:58.668460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637bbc1-070a-44aa-9636-61fe9f43674d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:58.673382 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637bbc1-070a-44aa-9636-61fe9f43674d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:58.680642 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1251/2483] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:45:58.684584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176e0d-bc39-4c1e-8673-9aa26614b765 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:58.695080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176e0d-bc39-4c1e-8673-9aa26614b765 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:58.699764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d0c0b-0da0-411f-ad13-7abeac11a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:58.700624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d0c0b-0da0-411f-ad13-7abeac11a95e admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:58.700909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d0c0b-0da0-411f-ad13-7abeac11a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:58.701191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d0c0b-0da0-411f-ad13-7abeac11a95e admin admin] PATH_INFO: `/v3/projects/a36eaef9740b47de9f6cae93ffcf4955/users/a2b81a8d35f940ce85b14559b70de582/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:58.716277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d0c0b-0da0-411f-ad13-7abeac11a95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36eaef9740b47de9f6cae93ffcf4955, user_id=a2b81a8d35f940ce85b14559b70de582, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:58.718862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d0c0b-0da0-411f-ad13-7abeac11a95e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:58.802893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1233/2484] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:45:58 2022] PUT /identity/v3/projects/a36eaef9740b47de9f6cae93ffcf4955/users/a2b81a8d35f940ce85b14559b70de582/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:45:58.816565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a69b-6828-4291-afbf-ab842fc66fcc None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:58.816863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a69b-6828-4291-afbf-ab842fc66fcc None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:58.817139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a69b-6828-4291-afbf-ab842fc66fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:58.842484 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-bb86a69b-6828-4291-afbf-ab842fc66fcc None None] MFA Rules not processed for user `a2b81a8d35f940ce85b14559b70de582`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:45:58.843667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-bb86a69b-6828-4291-afbf-ab842fc66fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:58.908625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1252/2485] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:45:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:45:58.919971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d0c0b-0da0-411f-ad13-7abeac11a95e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:58.921888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9c5d0c0b-0da0-411f-ad13-7abeac11a95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:58.997108 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d0c0b-0da0-411f-ad13-7abeac11a95e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:59.002573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bda9c-0a47-4bdc-a77b-cc500a790e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:59.003276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bda9c-0a47-4bdc-a77b-cc500a790e0d service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:59.004140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bda9c-0a47-4bdc-a77b-cc500a790e0d service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:59.004421 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bda9c-0a47-4bdc-a77b-cc500a790e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:59.012403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bda9c-0a47-4bdc-a77b-cc500a790e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:59.014330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bda9c-0a47-4bdc-a77b-cc500a790e0d service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:59.023439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1234/2486] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:02.483072 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86a69b-6828-4291-afbf-ab842fc66fcc None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:02.545018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86a69b-6828-4291-afbf-ab842fc66fcc None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:02.549462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:02.550327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:02.550603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:02.550874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] PATH_INFO: `/v3/users/a2b81a8d35f940ce85b14559b70de582` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:02.552070 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b81a8d35f940ce85b14559b70de582)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:02.554506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:02.575630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:02.781474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b81a8d35f940ce85b14559b70de582'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:02.782139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b81a8d35f940ce85b14559b70de582'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:02.789467 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b81a8d35f940ce85b14559b70de582'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:02.888170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b81a8d35f940ce85b14559b70de582'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:02.900871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b81a8d35f940ce85b14559b70de582'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:02.906907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1253/2487] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:02 2022] DELETE /identity/v3/users/a2b81a8d35f940ce85b14559b70de582 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:02.911433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad28b8-8f40-4bb6-a23f-3d182e8ca58e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:02.911961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad28b8-8f40-4bb6-a23f-3d182e8ca58e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:02.912056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad28b8-8f40-4bb6-a23f-3d182e8ca58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:02.929763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-82ad28b8-8f40-4bb6-a23f-3d182e8ca58e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:02.930987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-82ad28b8-8f40-4bb6-a23f-3d182e8ca58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:02.986902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1235/2488] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:02.996944 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:02.998394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:03.056499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa5852-44f0-40a9-97f1-dc75b10a4db2 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:03.060282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d5086-c261-4126-9577-6a7fb4b64f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:03.060937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d5086-c261-4126-9577-6a7fb4b64f51 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:03.061219 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d5086-c261-4126-9577-6a7fb4b64f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:03.061493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d5086-c261-4126-9577-6a7fb4b64f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:03.071255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d5086-c261-4126-9577-6a7fb4b64f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:03.072839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d5086-c261-4126-9577-6a7fb4b64f51 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:03.085549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1254/2489] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:03.516995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad28b8-8f40-4bb6-a23f-3d182e8ca58e None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:03.518066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-82ad28b8-8f40-4bb6-a23f-3d182e8ca58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:03.530276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad28b8-8f40-4bb6-a23f-3d182e8ca58e None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:03.535490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:03.536638 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:03.536992 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:03.537863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] PATH_INFO: `/v3/projects/a36eaef9740b47de9f6cae93ffcf4955` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:03.539206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36eaef9740b47de9f6cae93ffcf4955)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:03.541276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:03.638550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:03.655259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36eaef9740b47de9f6cae93ffcf4955', 'request_id': 'req-01a9bf23-3084-4fd1-90e3-97a578bca5b4'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:03.661723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36eaef9740b47de9f6cae93ffcf4955', 'request_id': 'req-01a9bf23-3084-4fd1-90e3-97a578bca5b4'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:03.744737 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36eaef9740b47de9f6cae93ffcf4955', 'request_id': 'req-01a9bf23-3084-4fd1-90e3-97a578bca5b4'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:03.756317 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] The token cache is being invalidate because project a36eaef9740b47de9f6cae93ffcf4955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:03.756606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:03.757235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-01a9bf23-3084-4fd1-90e3-97a578bca5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:03.758770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1236/2490] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:03 2022] DELETE /identity/v3/projects/a36eaef9740b47de9f6cae93ffcf4955 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:03.764161 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54cae-a7db-422e-a723-72f0a38e42da None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:03.764632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54cae-a7db-422e-a723-72f0a38e42da None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:03.764839 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54cae-a7db-422e-a723-72f0a38e42da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:03.782063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-f6a54cae-a7db-422e-a723-72f0a38e42da None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:03.783252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f6a54cae-a7db-422e-a723-72f0a38e42da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:03.842356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1255/2491] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:03.850723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa910d-ddde-4f79-a39d-f349166b0669 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:03.851013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa910d-ddde-4f79-a39d-f349166b0669 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:03.851294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa910d-ddde-4f79-a39d-f349166b0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:03.877260 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b0aa910d-ddde-4f79-a39d-f349166b0669 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:03.878503 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b0aa910d-ddde-4f79-a39d-f349166b0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:03.886863 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1237/2492] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:03.891421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a54cae-a7db-422e-a723-72f0a38e42da None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:03.901719 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a54cae-a7db-422e-a723-72f0a38e42da None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:03.906391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609f33b-8f64-4025-999b-0029f78ba3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:03.907036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f33b-8f64-4025-999b-0029f78ba3fc admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:03.907324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f33b-8f64-4025-999b-0029f78ba3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:03.907603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609f33b-8f64-4025-999b-0029f78ba3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:03.908364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609f33b-8f64-4025-999b-0029f78ba3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:03.908719 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609f33b-8f64-4025-999b-0029f78ba3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:03.910265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609f33b-8f64-4025-999b-0029f78ba3fc admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:03.923059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1256/2493] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:03.927200 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa910d-ddde-4f79-a39d-f349166b0669 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:03.936754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa910d-ddde-4f79-a39d-f349166b0669 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:03.941833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bcc97-37b5-4e06-b658-7dafbea8e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:03.942487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bcc97-37b5-4e06-b658-7dafbea8e28b admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:03.942770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bcc97-37b5-4e06-b658-7dafbea8e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:03.943048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bcc97-37b5-4e06-b658-7dafbea8e28b admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:03.943777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bcc97-37b5-4e06-b658-7dafbea8e28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:03.945699 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bcc97-37b5-4e06-b658-7dafbea8e28b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:04.043725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1238/2494] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:03 2022] POST /identity/v3/projects => generated 401 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:04.047673 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609f33b-8f64-4025-999b-0029f78ba3fc admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:04.058426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609f33b-8f64-4025-999b-0029f78ba3fc admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:04.085177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:04.115969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a4d0-2f63-46f1-b767-24f6c13defe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:04.116631 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a4d0-2f63-46f1-b767-24f6c13defe4 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:04.116924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a4d0-2f63-46f1-b767-24f6c13defe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:04.117187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a4d0-2f63-46f1-b767-24f6c13defe4 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:04.117875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2a4d0-2f63-46f1-b767-24f6c13defe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:04.119808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2a4d0-2f63-46f1-b767-24f6c13defe4 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:04.217140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1257/2495] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:04 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:04.221141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bcc97-37b5-4e06-b658-7dafbea8e28b admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:04.232196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bcc97-37b5-4e06-b658-7dafbea8e28b admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:04.236786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8880-6fd1-4261-b6d1-4c712819a755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:04.237439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8880-6fd1-4261-b6d1-4c712819a755 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:04.237724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8880-6fd1-4261-b6d1-4c712819a755 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:04.238001 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8880-6fd1-4261-b6d1-4c712819a755 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:04.238714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c8880-6fd1-4261-b6d1-4c712819a755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:04.240972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c8880-6fd1-4261-b6d1-4c712819a755 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:04.251460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1239/2496] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:04.258616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a4d0-2f63-46f1-b767-24f6c13defe4 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:04.274017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a4d0-2f63-46f1-b767-24f6c13defe4 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:04.274017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a2607-3302-453d-a48f-92e35aeda9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:04.274281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2607-3302-453d-a48f-92e35aeda9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:04.274568 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2607-3302-453d-a48f-92e35aeda9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:04.274845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2607-3302-453d-a48f-92e35aeda9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:04.275558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a2607-3302-453d-a48f-92e35aeda9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:04.277184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a2607-3302-453d-a48f-92e35aeda9e7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:04.287997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1258/2497] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:04.292196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8880-6fd1-4261-b6d1-4c712819a755 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:04.302100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8880-6fd1-4261-b6d1-4c712819a755 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:04.312729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf44a53-bf8b-4854-bdd1-3c83a6d47f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:04.313635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf44a53-bf8b-4854-bdd1-3c83a6d47f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:04.313917 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf44a53-bf8b-4854-bdd1-3c83a6d47f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:04.314194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf44a53-bf8b-4854-bdd1-3c83a6d47f48 admin admin] PATH_INFO: `/v3/projects/5555b3529db64c9f92d81bebae9246b2/users/42a0a1f10aaa4d19aae63b831f779481/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:04.330573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf44a53-bf8b-4854-bdd1-3c83a6d47f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5555b3529db64c9f92d81bebae9246b2, user_id=42a0a1f10aaa4d19aae63b831f779481, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:04.333274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf44a53-bf8b-4854-bdd1-3c83a6d47f48 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:04.396664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1240/2498] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:04 2022] PUT /identity/v3/projects/5555b3529db64c9f92d81bebae9246b2/users/42a0a1f10aaa4d19aae63b831f779481/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:04.408046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2709c7-7441-440d-b51a-c357152b31ea None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:04.408372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2709c7-7441-440d-b51a-c357152b31ea None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:04.408652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2709c7-7441-440d-b51a-c357152b31ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:04.435305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7b2709c7-7441-440d-b51a-c357152b31ea None None] MFA Rules not processed for user `42a0a1f10aaa4d19aae63b831f779481`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:04.436529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7b2709c7-7441-440d-b51a-c357152b31ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:04.498076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1259/2499] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:04.502718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf44a53-bf8b-4854-bdd1-3c83a6d47f48 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:04.564789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf44a53-bf8b-4854-bdd1-3c83a6d47f48 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:04.569456 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d0603-f1be-4beb-85db-d618a1303cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:04.570112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0603-f1be-4beb-85db-d618a1303cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:04.570396 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0603-f1be-4beb-85db-d618a1303cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:04.570674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0603-f1be-4beb-85db-d618a1303cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:04.571352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d0603-f1be-4beb-85db-d618a1303cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:04.573290 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d0603-f1be-4beb-85db-d618a1303cc0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:04.688651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1241/2500] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:04 2022] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:04.692602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2709c7-7441-440d-b51a-c357152b31ea None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:04.703795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2709c7-7441-440d-b51a-c357152b31ea None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:04.760651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe0c81-d085-4f86-be13-cff565245a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:04.761321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe0c81-d085-4f86-be13-cff565245a0e admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:04.761600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe0c81-d085-4f86-be13-cff565245a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:04.761877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe0c81-d085-4f86-be13-cff565245a0e admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:04.762555 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe0c81-d085-4f86-be13-cff565245a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:04.764766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe0c81-d085-4f86-be13-cff565245a0e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:04.879129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1260/2501] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:04 2022] POST /identity/v3/users => generated 308 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:04.883873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d0603-f1be-4beb-85db-d618a1303cc0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:04.894511 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d0603-f1be-4beb-85db-d618a1303cc0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:04.899102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3762c2-88f1-45f0-b8e9-52d07ffac5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:04.899776 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3762c2-88f1-45f0-b8e9-52d07ffac5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:04.900067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3762c2-88f1-45f0-b8e9-52d07ffac5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:04.900347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3762c2-88f1-45f0-b8e9-52d07ffac5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:04.901102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3762c2-88f1-45f0-b8e9-52d07ffac5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:04.902690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3762c2-88f1-45f0-b8e9-52d07ffac5b2 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:04.913455 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1242/2502] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:04.917415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe0c81-d085-4f86-be13-cff565245a0e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:04.927231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe0c81-d085-4f86-be13-cff565245a0e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:04.932621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589cfc9-8e4b-4f54-a8a3-439ac9e3adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:04.933482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589cfc9-8e4b-4f54-a8a3-439ac9e3adee admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:04.933761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589cfc9-8e4b-4f54-a8a3-439ac9e3adee admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:04.934036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589cfc9-8e4b-4f54-a8a3-439ac9e3adee admin admin] PATH_INFO: `/v3/projects/f67fdeb27b634cd58c75921da2e634b8/users/c21b7c6b51f64fd78221f74444d599b1/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:04.948878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589cfc9-8e4b-4f54-a8a3-439ac9e3adee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67fdeb27b634cd58c75921da2e634b8, user_id=c21b7c6b51f64fd78221f74444d599b1, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:04.951581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589cfc9-8e4b-4f54-a8a3-439ac9e3adee admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:05.019278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1261/2503] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:04 2022] PUT /identity/v3/projects/f67fdeb27b634cd58c75921da2e634b8/users/c21b7c6b51f64fd78221f74444d599b1/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:05.023768 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3762c2-88f1-45f0-b8e9-52d07ffac5b2 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:05.034138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3762c2-88f1-45f0-b8e9-52d07ffac5b2 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:05.057029 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:05.094051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb8762-429f-40cf-b988-3d91ffe78aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:05.094783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb8762-429f-40cf-b988-3d91ffe78aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:05.095604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb8762-429f-40cf-b988-3d91ffe78aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:05.095962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb8762-429f-40cf-b988-3d91ffe78aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:05.096715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb8762-429f-40cf-b988-3d91ffe78aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:05.098343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb8762-429f-40cf-b988-3d91ffe78aa2 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:05.109611 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1243/2504] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:05.113759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589cfc9-8e4b-4f54-a8a3-439ac9e3adee admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:05.119894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:05.125035 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589cfc9-8e4b-4f54-a8a3-439ac9e3adee admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:05.129972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc441f0-13f9-474e-862c-3e7ee9cfc1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:05.130877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc441f0-13f9-474e-862c-3e7ee9cfc1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:05.131167 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc441f0-13f9-474e-862c-3e7ee9cfc1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:05.131445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc441f0-13f9-474e-862c-3e7ee9cfc1dc admin admin] PATH_INFO: `/v3/projects/f67fdeb27b634cd58c75921da2e634b8/users/c21b7c6b51f64fd78221f74444d599b1/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:05.133560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc441f0-13f9-474e-862c-3e7ee9cfc1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67fdeb27b634cd58c75921da2e634b8, user_id=c21b7c6b51f64fd78221f74444d599b1, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:05.136271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc441f0-13f9-474e-862c-3e7ee9cfc1dc admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:05.147069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1262/2505] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:05 2022] PUT /identity/v3/projects/f67fdeb27b634cd58c75921da2e634b8/users/c21b7c6b51f64fd78221f74444d599b1/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:05.157057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27fe0b-c186-4ab0-8a51-9585dee27f5b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:05.157349 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27fe0b-c186-4ab0-8a51-9585dee27f5b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:05.157624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27fe0b-c186-4ab0-8a51-9585dee27f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:05.186716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ca27fe0b-c186-4ab0-8a51-9585dee27f5b None None] MFA Rules not processed for user `c21b7c6b51f64fd78221f74444d599b1`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:05.186716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ca27fe0b-c186-4ab0-8a51-9585dee27f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:05.256999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1244/2506] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:05.267717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc441f0-13f9-474e-862c-3e7ee9cfc1dc admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:05.269404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8fc441f0-13f9-474e-862c-3e7ee9cfc1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:05.325695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc441f0-13f9-474e-862c-3e7ee9cfc1dc admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:05.329292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111d725-f708-40fb-bc11-e15ee3ce4f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:05.329915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111d725-f708-40fb-bc11-e15ee3ce4f14 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:05.330198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111d725-f708-40fb-bc11-e15ee3ce4f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:05.330471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111d725-f708-40fb-bc11-e15ee3ce4f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:05.339850 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111d725-f708-40fb-bc11-e15ee3ce4f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:05.341276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111d725-f708-40fb-bc11-e15ee3ce4f14 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:05.351160 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1263/2507] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:05.495550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27fe0b-c186-4ab0-8a51-9585dee27f5b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:05.557434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27fe0b-c186-4ab0-8a51-9585dee27f5b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:05.561892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:05.562730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:05.563013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:05.563311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] PATH_INFO: `/v3/users/42a0a1f10aaa4d19aae63b831f779481` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:05.564494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a0a1f10aaa4d19aae63b831f779481)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:05.566404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:05.804138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a0a1f10aaa4d19aae63b831f779481'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:05.804826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a0a1f10aaa4d19aae63b831f779481'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:05.806569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:05.899085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a0a1f10aaa4d19aae63b831f779481'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:05.906226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a0a1f10aaa4d19aae63b831f779481'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:05.918161 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a0a1f10aaa4d19aae63b831f779481'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:05.923980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1245/2508] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:05 2022] DELETE /identity/v3/users/42a0a1f10aaa4d19aae63b831f779481 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:05.929215 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16103f60-9a9e-4dd3-b7de-f982b2b28a3a None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:05.929707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16103f60-9a9e-4dd3-b7de-f982b2b28a3a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:05.929802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16103f60-9a9e-4dd3-b7de-f982b2b28a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:05.946868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-16103f60-9a9e-4dd3-b7de-f982b2b28a3a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:05.948118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-16103f60-9a9e-4dd3-b7de-f982b2b28a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:06.006961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1264/2509] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:06.016726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:06.018181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:06.077011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7742ff7-ac78-411f-9249-b94a1f452f7c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:06.080660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2668a0d-e16c-444c-962f-9fdfbf121c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:06.081295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668a0d-e16c-444c-962f-9fdfbf121c8a service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:06.081573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668a0d-e16c-444c-962f-9fdfbf121c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:06.081848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668a0d-e16c-444c-962f-9fdfbf121c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:06.091280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2668a0d-e16c-444c-962f-9fdfbf121c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:06.092727 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2668a0d-e16c-444c-962f-9fdfbf121c8a service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:06.102627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1246/2510] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:06.517766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16103f60-9a9e-4dd3-b7de-f982b2b28a3a None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:06.519201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-16103f60-9a9e-4dd3-b7de-f982b2b28a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:06.531955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16103f60-9a9e-4dd3-b7de-f982b2b28a3a None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:06.536606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:06.537500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:06.537777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:06.538051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] PATH_INFO: `/v3/projects/5555b3529db64c9f92d81bebae9246b2` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:06.539918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5555b3529db64c9f92d81bebae9246b2)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:06.541937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:06.663401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5555b3529db64c9f92d81bebae9246b2', 'request_id': 'req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:06.668906 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5555b3529db64c9f92d81bebae9246b2', 'request_id': 'req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:06.675079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5555b3529db64c9f92d81bebae9246b2', 'request_id': 'req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:06.766971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] The token cache is being invalidate because project 5555b3529db64c9f92d81bebae9246b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:06.767255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:06.767904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:06.769422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1265/2511] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:06 2022] DELETE /identity/v3/projects/5555b3529db64c9f92d81bebae9246b2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:06.773964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2668a0d-e16c-444c-962f-9fdfbf121c8a service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:06.783508 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2668a0d-e16c-444c-962f-9fdfbf121c8a service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:06.839678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:06.840566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:06.840847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:06.841120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] PATH_INFO: `/v3/users/c21b7c6b51f64fd78221f74444d599b1` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:06.842300 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21b7c6b51f64fd78221f74444d599b1)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:06.844234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:07.015442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21b7c6b51f64fd78221f74444d599b1'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.016044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21b7c6b51f64fd78221f74444d599b1'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.073185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21b7c6b51f64fd78221f74444d599b1'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.080704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21b7c6b51f64fd78221f74444d599b1'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.086196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:07.093115 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f106757d-5d89-41fa-ae6c-087139cf9150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21b7c6b51f64fd78221f74444d599b1'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.099020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1247/2512] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:06 2022] DELETE /identity/v3/users/c21b7c6b51f64fd78221f74444d599b1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:07.539544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:07.541039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:07.554368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2578c85-d0f5-46d3-be8b-bc629aa1a13d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:07.568482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:07.620781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:07.621641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:07.621925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:07.622203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] PATH_INFO: `/v3/projects/f67fdeb27b634cd58c75921da2e634b8` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:07.623371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67fdeb27b634cd58c75921da2e634b8)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:07.625353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:07.780858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67fdeb27b634cd58c75921da2e634b8', 'request_id': 'req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.786325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67fdeb27b634cd58c75921da2e634b8', 'request_id': 'req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.793816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67fdeb27b634cd58c75921da2e634b8', 'request_id': 'req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.927265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] The token cache is being invalidate because project f67fdeb27b634cd58c75921da2e634b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:07.927566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.928202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-ad0ae726-2045-4a6d-8e60-de01e8ae0c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:07.929731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1266/2513] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:07 2022] DELETE /identity/v3/projects/f67fdeb27b634cd58c75921da2e634b8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:07.934561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560591bf-9406-4d43-9771-bdeb46029a06 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:07.934853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560591bf-9406-4d43-9771-bdeb46029a06 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:07.935136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560591bf-9406-4d43-9771-bdeb46029a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:07.953484 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-560591bf-9406-4d43-9771-bdeb46029a06 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:07.954662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-560591bf-9406-4d43-9771-bdeb46029a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:08.014545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1248/2514] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:08.024152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf01c-3502-4309-9bee-ff41fc5bd9f6 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.024534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf01c-3502-4309-9bee-ff41fc5bd9f6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.024898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf01c-3502-4309-9bee-ff41fc5bd9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.043086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-cf8bf01c-3502-4309-9bee-ff41fc5bd9f6 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:08.044310 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cf8bf01c-3502-4309-9bee-ff41fc5bd9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:08.052294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1267/2515] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:08.056766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560591bf-9406-4d43-9771-bdeb46029a06 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:08.066871 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560591bf-9406-4d43-9771-bdeb46029a06 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:08.072076 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91071a1f-19ab-4755-bbc5-7ee927c8a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:08.072726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071a1f-19ab-4755-bbc5-7ee927c8a799 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.073012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071a1f-19ab-4755-bbc5-7ee927c8a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.073294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071a1f-19ab-4755-bbc5-7ee927c8a799 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.074021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071a1f-19ab-4755-bbc5-7ee927c8a799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:08.074328 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071a1f-19ab-4755-bbc5-7ee927c8a799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:08.075979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071a1f-19ab-4755-bbc5-7ee927c8a799 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:08.088097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1249/2516] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:08.092338 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf01c-3502-4309-9bee-ff41fc5bd9f6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:08.101803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf01c-3502-4309-9bee-ff41fc5bd9f6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:08.106459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfe28f-4216-408c-95c3-57007229e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:08.107090 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfe28f-4216-408c-95c3-57007229e692 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.107367 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfe28f-4216-408c-95c3-57007229e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.107638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfe28f-4216-408c-95c3-57007229e692 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.108354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfe28f-4216-408c-95c3-57007229e692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:08.110585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfe28f-4216-408c-95c3-57007229e692 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:08.209856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1268/2517] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:08 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:46:08.214201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91071a1f-19ab-4755-bbc5-7ee927c8a799 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:08.224247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91071a1f-19ab-4755-bbc5-7ee927c8a799 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:08.279522 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6f8b3-cbfa-4376-b859-07d8e62d59be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:08.280206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6f8b3-cbfa-4376-b859-07d8e62d59be admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.280487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6f8b3-cbfa-4376-b859-07d8e62d59be admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.280765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6f8b3-cbfa-4376-b859-07d8e62d59be admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.281453 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6f8b3-cbfa-4376-b859-07d8e62d59be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:08.283394 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6f8b3-cbfa-4376-b859-07d8e62d59be admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:08.367576 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1250/2518] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:08 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:08.371802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfe28f-4216-408c-95c3-57007229e692 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:08.382837 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfe28f-4216-408c-95c3-57007229e692 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:08.387390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fc23e-8e64-4b5e-a069-7da48c4ce881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:08.388328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fc23e-8e64-4b5e-a069-7da48c4ce881 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.388609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fc23e-8e64-4b5e-a069-7da48c4ce881 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.389012 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fc23e-8e64-4b5e-a069-7da48c4ce881 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.389731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fc23e-8e64-4b5e-a069-7da48c4ce881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:08.391332 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fc23e-8e64-4b5e-a069-7da48c4ce881 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:08.401183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1269/2519] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:08.405054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6f8b3-cbfa-4376-b859-07d8e62d59be admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:08.414983 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6f8b3-cbfa-4376-b859-07d8e62d59be admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:08.420002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0ddb4-419d-4329-add6-ba3638eb04fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:08.420672 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0ddb4-419d-4329-add6-ba3638eb04fd admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.420979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0ddb4-419d-4329-add6-ba3638eb04fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.421262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0ddb4-419d-4329-add6-ba3638eb04fd admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.422038 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0ddb4-419d-4329-add6-ba3638eb04fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:08.423620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0ddb4-419d-4329-add6-ba3638eb04fd admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:08.434714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1251/2520] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:08.438814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fc23e-8e64-4b5e-a069-7da48c4ce881 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:08.449322 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fc23e-8e64-4b5e-a069-7da48c4ce881 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:08.453905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c47867-ff32-4e68-baed-47f5f3b7e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:08.454766 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47867-ff32-4e68-baed-47f5f3b7e306 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.455049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47867-ff32-4e68-baed-47f5f3b7e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.455327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47867-ff32-4e68-baed-47f5f3b7e306 admin admin] PATH_INFO: `/v3/projects/1b668dda193f4cc2a68f69ed356d3192/users/815164fdd68447969c8eb11fd433f3e8/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.469869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c47867-ff32-4e68-baed-47f5f3b7e306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b668dda193f4cc2a68f69ed356d3192, user_id=815164fdd68447969c8eb11fd433f3e8, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:08.472567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c47867-ff32-4e68-baed-47f5f3b7e306 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:08.578895 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1270/2521] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:08 2022] PUT /identity/v3/projects/1b668dda193f4cc2a68f69ed356d3192/users/815164fdd68447969c8eb11fd433f3e8/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:08.597165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0026f3-bbb7-42d2-a209-b037ea209dd3 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.597459 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0026f3-bbb7-42d2-a209-b037ea209dd3 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.597737 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0026f3-bbb7-42d2-a209-b037ea209dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.624752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-db0026f3-bbb7-42d2-a209-b037ea209dd3 None None] MFA Rules not processed for user `815164fdd68447969c8eb11fd433f3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:08.625889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-db0026f3-bbb7-42d2-a209-b037ea209dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:08.668153 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:08.691331 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1252/2522] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:08.696348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c47867-ff32-4e68-baed-47f5f3b7e306 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:08.733331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:08.763680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c47867-ff32-4e68-baed-47f5f3b7e306 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:08.768289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6bf1-9191-4ff9-a5e4-93dbdaa40205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:08.771663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6bf1-9191-4ff9-a5e4-93dbdaa40205 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.771663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6bf1-9191-4ff9-a5e4-93dbdaa40205 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.771663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6bf1-9191-4ff9-a5e4-93dbdaa40205 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.771663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6bf1-9191-4ff9-a5e4-93dbdaa40205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:08.772732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6bf1-9191-4ff9-a5e4-93dbdaa40205 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:08.892854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1271/2523] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:08 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:08.894017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0026f3-bbb7-42d2-a209-b037ea209dd3 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:08.905273 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0026f3-bbb7-42d2-a209-b037ea209dd3 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:08.961058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3f05-1759-4384-91b8-87fecfdc06c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:08.961721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3f05-1759-4384-91b8-87fecfdc06c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:08.962004 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3f05-1759-4384-91b8-87fecfdc06c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:08.962279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3f05-1759-4384-91b8-87fecfdc06c8 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:08.962950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3f05-1759-4384-91b8-87fecfdc06c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:08.964897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3f05-1759-4384-91b8-87fecfdc06c8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:09.065948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1253/2524] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:08 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:46:09.067164 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6bf1-9191-4ff9-a5e4-93dbdaa40205 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:09.078293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6bf1-9191-4ff9-a5e4-93dbdaa40205 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:09.083001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7797cf-5d84-42ee-945c-e148a4be110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:09.083653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7797cf-5d84-42ee-945c-e148a4be110a admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:09.083968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7797cf-5d84-42ee-945c-e148a4be110a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:09.084817 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7797cf-5d84-42ee-945c-e148a4be110a admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:09.088054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7797cf-5d84-42ee-945c-e148a4be110a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:09.088054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7797cf-5d84-42ee-945c-e148a4be110a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:09.098855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1272/2525] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:09.102783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3f05-1759-4384-91b8-87fecfdc06c8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:09.113006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3f05-1759-4384-91b8-87fecfdc06c8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:09.118164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dc83d-01e9-4d8a-81e1-afb794f6a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:09.119060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dc83d-01e9-4d8a-81e1-afb794f6a95c admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:09.119348 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dc83d-01e9-4d8a-81e1-afb794f6a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:09.119621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dc83d-01e9-4d8a-81e1-afb794f6a95c admin admin] PATH_INFO: `/v3/projects/9651ccc970db49af830e8c8860951081/users/38bf1b929f1f4ae2a2d602743f84c790/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:09.136549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dc83d-01e9-4d8a-81e1-afb794f6a95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9651ccc970db49af830e8c8860951081, user_id=38bf1b929f1f4ae2a2d602743f84c790, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:09.139514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dc83d-01e9-4d8a-81e1-afb794f6a95c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:09.210669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1254/2526] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:09 2022] PUT /identity/v3/projects/9651ccc970db49af830e8c8860951081/users/38bf1b929f1f4ae2a2d602743f84c790/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:09.214572 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7797cf-5d84-42ee-945c-e148a4be110a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:09.224987 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7797cf-5d84-42ee-945c-e148a4be110a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:09.283321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae7cc9-d42f-4c80-822f-d7be248a0027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:09.284010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7cc9-d42f-4c80-822f-d7be248a0027 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:09.284301 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7cc9-d42f-4c80-822f-d7be248a0027 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:09.284579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7cc9-d42f-4c80-822f-d7be248a0027 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:09.285293 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae7cc9-d42f-4c80-822f-d7be248a0027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:09.286943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae7cc9-d42f-4c80-822f-d7be248a0027 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:09.296970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1273/2527] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:09.300948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dc83d-01e9-4d8a-81e1-afb794f6a95c admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:09.311599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dc83d-01e9-4d8a-81e1-afb794f6a95c admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:09.316150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c4873-03f6-4dd6-83bc-38577b4600ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:09.317005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c4873-03f6-4dd6-83bc-38577b4600ad admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:09.317278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c4873-03f6-4dd6-83bc-38577b4600ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:09.317549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c4873-03f6-4dd6-83bc-38577b4600ad admin admin] PATH_INFO: `/v3/projects/9651ccc970db49af830e8c8860951081/users/38bf1b929f1f4ae2a2d602743f84c790/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:09.320147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c4873-03f6-4dd6-83bc-38577b4600ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9651ccc970db49af830e8c8860951081, user_id=38bf1b929f1f4ae2a2d602743f84c790, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:09.322803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c4873-03f6-4dd6-83bc-38577b4600ad admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:09.332896 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1255/2528] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:09 2022] PUT /identity/v3/projects/9651ccc970db49af830e8c8860951081/users/38bf1b929f1f4ae2a2d602743f84c790/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:09.342576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09c3e7-a0e2-46ea-bbf6-614c445d3305 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:09.342873 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09c3e7-a0e2-46ea-bbf6-614c445d3305 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:09.343155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09c3e7-a0e2-46ea-bbf6-614c445d3305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:09.368974 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-fd09c3e7-a0e2-46ea-bbf6-614c445d3305 None None] MFA Rules not processed for user `38bf1b929f1f4ae2a2d602743f84c790`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:09.370177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fd09c3e7-a0e2-46ea-bbf6-614c445d3305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:09.436767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1274/2529] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:09.449695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c4873-03f6-4dd6-83bc-38577b4600ad admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:09.451345 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d68c4873-03f6-4dd6-83bc-38577b4600ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:09.506774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c4873-03f6-4dd6-83bc-38577b4600ad admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:09.510446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fca1a5-6d9a-4433-8c42-0efcbe33bfc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:09.511071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fca1a5-6d9a-4433-8c42-0efcbe33bfc4 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:09.511354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fca1a5-6d9a-4433-8c42-0efcbe33bfc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:09.511628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fca1a5-6d9a-4433-8c42-0efcbe33bfc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:09.520832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fca1a5-6d9a-4433-8c42-0efcbe33bfc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:09.522278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fca1a5-6d9a-4433-8c42-0efcbe33bfc4 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:09.531582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1256/2530] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:10.648568 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09c3e7-a0e2-46ea-bbf6-614c445d3305 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:10.679884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:10.710151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09c3e7-a0e2-46ea-bbf6-614c445d3305 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:10.715565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:10.717122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:10.717122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:10.717122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] PATH_INFO: `/v3/users/815164fdd68447969c8eb11fd433f3e8` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:10.718331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] RBAC: Authorizing `identity:delete_user(user_id=815164fdd68447969c8eb11fd433f3e8)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:10.720336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:10.892345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '815164fdd68447969c8eb11fd433f3e8'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:10.892909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '815164fdd68447969c8eb11fd433f3e8'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:10.899830 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '815164fdd68447969c8eb11fd433f3e8'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:10.967473 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '815164fdd68447969c8eb11fd433f3e8'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:10.980904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '815164fdd68447969c8eb11fd433f3e8'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:10.986980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1275/2531] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:10 2022] DELETE /identity/v3/users/815164fdd68447969c8eb11fd433f3e8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:10.992242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa54ae-f951-429d-bf36-3d2ae37e5bc7 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:10.992720 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa54ae-f951-429d-bf36-3d2ae37e5bc7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:10.992926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa54ae-f951-429d-bf36-3d2ae37e5bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:11.010775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-faaa54ae-f951-429d-bf36-3d2ae37e5bc7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:11.012041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-faaa54ae-f951-429d-bf36-3d2ae37e5bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:11.050099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:11.076968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1257/2532] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:46:11.086326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:11.087941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:11.145138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be87b2-5bcf-4a07-871b-9abab577face admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:11.148698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e265dfe-fcf8-4f3f-9218-250d50034318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:11.149331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e265dfe-fcf8-4f3f-9218-250d50034318 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:11.149612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e265dfe-fcf8-4f3f-9218-250d50034318 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:11.149887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e265dfe-fcf8-4f3f-9218-250d50034318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:11.158662 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e265dfe-fcf8-4f3f-9218-250d50034318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:11.160130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e265dfe-fcf8-4f3f-9218-250d50034318 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:11.169840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1276/2533] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:46:11.650002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa54ae-f951-429d-bf36-3d2ae37e5bc7 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:11.651374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-faaa54ae-f951-429d-bf36-3d2ae37e5bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:11.663900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa54ae-f951-429d-bf36-3d2ae37e5bc7 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:11.668499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:11.669361 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:11.675035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:11.675035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] PATH_INFO: `/v3/projects/1b668dda193f4cc2a68f69ed356d3192` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:11.675035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b668dda193f4cc2a68f69ed356d3192)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:11.675035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:11.813258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b668dda193f4cc2a68f69ed356d3192', 'request_id': 'req-b3e5a19a-e73c-4025-ae33-632e80239db5'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:11.819819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b668dda193f4cc2a68f69ed356d3192', 'request_id': 'req-b3e5a19a-e73c-4025-ae33-632e80239db5'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:11.876073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b668dda193f4cc2a68f69ed356d3192', 'request_id': 'req-b3e5a19a-e73c-4025-ae33-632e80239db5'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:11.886825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] The token cache is being invalidate because project 1b668dda193f4cc2a68f69ed356d3192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:11.887109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:11.888051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:11.889530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1258/2534] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:11 2022] DELETE /identity/v3/projects/1b668dda193f4cc2a68f69ed356d3192 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:11.893476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e265dfe-fcf8-4f3f-9218-250d50034318 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:11.903721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e265dfe-fcf8-4f3f-9218-250d50034318 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:11.949499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:11.958840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:11.959706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:11.960566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:11.960846 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] PATH_INFO: `/v3/users/38bf1b929f1f4ae2a2d602743f84c790` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:11.962035 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=38bf1b929f1f4ae2a2d602743f84c790)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:11.964148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:12.180746 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38bf1b929f1f4ae2a2d602743f84c790'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:12.182211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38bf1b929f1f4ae2a2d602743f84c790'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:12.189663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38bf1b929f1f4ae2a2d602743f84c790'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:12.257482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38bf1b929f1f4ae2a2d602743f84c790'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:12.270574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-9a0d6217-d445-41a1-8d8c-b84d23164fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38bf1b929f1f4ae2a2d602743f84c790'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:12.276579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1277/2535] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:11 2022] DELETE /identity/v3/users/38bf1b929f1f4ae2a2d602743f84c790 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:12.766311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:12.767878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:12.780820 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a19a-e73c-4025-ae33-632e80239db5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:12.838151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:12.839208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:12.839492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:12.839790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] PATH_INFO: `/v3/projects/9651ccc970db49af830e8c8860951081` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:12.841070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9651ccc970db49af830e8c8860951081)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:12.843008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:12.938518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9651ccc970db49af830e8c8860951081', 'request_id': 'req-5cca20eb-17cf-4218-96b6-a29e84a7ce79'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:12.944587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9651ccc970db49af830e8c8860951081', 'request_id': 'req-5cca20eb-17cf-4218-96b6-a29e84a7ce79'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:13.042011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9651ccc970db49af830e8c8860951081', 'request_id': 'req-5cca20eb-17cf-4218-96b6-a29e84a7ce79'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:13.044351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:13.053190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] The token cache is being invalidate because project 9651ccc970db49af830e8c8860951081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:13.055431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:13.055431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5cca20eb-17cf-4218-96b6-a29e84a7ce79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:13.055952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1259/2536] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:12 2022] DELETE /identity/v3/projects/9651ccc970db49af830e8c8860951081 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:13.061228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699782c-4455-4982-8e7e-07bfdbba9554 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.061680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699782c-4455-4982-8e7e-07bfdbba9554 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.061792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699782c-4455-4982-8e7e-07bfdbba9554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.079771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a699782c-4455-4982-8e7e-07bfdbba9554 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:13.081026 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a699782c-4455-4982-8e7e-07bfdbba9554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:13.150776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1278/2537] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:13.160037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d705d3-f5ad-47ad-a85d-2dfe3e6de25b None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.160352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d705d3-f5ad-47ad-a85d-2dfe3e6de25b None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.160748 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d705d3-f5ad-47ad-a85d-2dfe3e6de25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.184053 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-13d705d3-f5ad-47ad-a85d-2dfe3e6de25b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:13.185304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-13d705d3-f5ad-47ad-a85d-2dfe3e6de25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:13.193475 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1260/2538] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:13.198119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699782c-4455-4982-8e7e-07bfdbba9554 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:13.207711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699782c-4455-4982-8e7e-07bfdbba9554 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:13.213185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5af56-71e5-4927-916c-6e4818d9d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:13.213840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5af56-71e5-4927-916c-6e4818d9d243 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.214157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5af56-71e5-4927-916c-6e4818d9d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.214437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5af56-71e5-4927-916c-6e4818d9d243 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.215159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5af56-71e5-4927-916c-6e4818d9d243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:13.215472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5af56-71e5-4927-916c-6e4818d9d243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:13.217124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5af56-71e5-4927-916c-6e4818d9d243 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:13.228490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1279/2539] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:13.232825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d705d3-f5ad-47ad-a85d-2dfe3e6de25b None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:13.241802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d705d3-f5ad-47ad-a85d-2dfe3e6de25b None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:13.246500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce85dc-227e-44c7-b0bf-d685ffe184a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:13.247137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce85dc-227e-44c7-b0bf-d685ffe184a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.247423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce85dc-227e-44c7-b0bf-d685ffe184a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.247703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce85dc-227e-44c7-b0bf-d685ffe184a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.248425 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce85dc-227e-44c7-b0bf-d685ffe184a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:13.250323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce85dc-227e-44c7-b0bf-d685ffe184a9 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:13.355505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1261/2540] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:13 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:13.361032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5af56-71e5-4927-916c-6e4818d9d243 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:13.371559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5af56-71e5-4927-916c-6e4818d9d243 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:13.427304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:13.433291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1002c5-ecde-4b3a-abd9-deedeac6caad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:13.433961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1002c5-ecde-4b3a-abd9-deedeac6caad admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.434248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1002c5-ecde-4b3a-abd9-deedeac6caad admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.434526 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1002c5-ecde-4b3a-abd9-deedeac6caad admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.435227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1002c5-ecde-4b3a-abd9-deedeac6caad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:13.437252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1002c5-ecde-4b3a-abd9-deedeac6caad admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:13.562221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1280/2541] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:13 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:13.566230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce85dc-227e-44c7-b0bf-d685ffe184a9 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:13.576994 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce85dc-227e-44c7-b0bf-d685ffe184a9 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:13.581573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c999e0b-2db4-48c1-9434-0a691bb4fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:13.582221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c999e0b-2db4-48c1-9434-0a691bb4fdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.582508 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c999e0b-2db4-48c1-9434-0a691bb4fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.582790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c999e0b-2db4-48c1-9434-0a691bb4fdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.583508 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c999e0b-2db4-48c1-9434-0a691bb4fdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:13.585154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c999e0b-2db4-48c1-9434-0a691bb4fdd8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:13.596448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1262/2542] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:13.607291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1002c5-ecde-4b3a-abd9-deedeac6caad admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:13.616948 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1002c5-ecde-4b3a-abd9-deedeac6caad admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:13.622252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb770d2f-203c-4cb6-98c0-60a70458a441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:13.622897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb770d2f-203c-4cb6-98c0-60a70458a441 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.623184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb770d2f-203c-4cb6-98c0-60a70458a441 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.623551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb770d2f-203c-4cb6-98c0-60a70458a441 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.624270 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb770d2f-203c-4cb6-98c0-60a70458a441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:13.625911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb770d2f-203c-4cb6-98c0-60a70458a441 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:13.637133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1281/2543] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:46:13.641900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c999e0b-2db4-48c1-9434-0a691bb4fdd8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:13.651652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c999e0b-2db4-48c1-9434-0a691bb4fdd8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:13.656259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b913d3-1b5f-4ff0-aae9-ad1982de5640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:13.657123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b913d3-1b5f-4ff0-aae9-ad1982de5640 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.657520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b913d3-1b5f-4ff0-aae9-ad1982de5640 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.657745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b913d3-1b5f-4ff0-aae9-ad1982de5640 admin admin] PATH_INFO: `/v3/projects/d4325e9059a3477990b5bf9798c8f61d/users/bfe31fd737074272aef8822ca271896c/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.672549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b913d3-1b5f-4ff0-aae9-ad1982de5640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4325e9059a3477990b5bf9798c8f61d, user_id=bfe31fd737074272aef8822ca271896c, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:13.675225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b913d3-1b5f-4ff0-aae9-ad1982de5640 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:13.745388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1263/2544] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:13 2022] PUT /identity/v3/projects/d4325e9059a3477990b5bf9798c8f61d/users/bfe31fd737074272aef8822ca271896c/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:13.755602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe061-0a67-4103-ac35-5dd460408610 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.755946 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe061-0a67-4103-ac35-5dd460408610 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.756226 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe061-0a67-4103-ac35-5dd460408610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.783162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-37efe061-0a67-4103-ac35-5dd460408610 None None] MFA Rules not processed for user `bfe31fd737074272aef8822ca271896c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:13.784437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-37efe061-0a67-4103-ac35-5dd460408610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:13.848013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1282/2545] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:13.852450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b913d3-1b5f-4ff0-aae9-ad1982de5640 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:13.912747 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b913d3-1b5f-4ff0-aae9-ad1982de5640 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:13.917864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41382d2-3869-4ca6-b7c9-cb1f4fc2ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:13.918510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41382d2-3869-4ca6-b7c9-cb1f4fc2ffc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:13.918792 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41382d2-3869-4ca6-b7c9-cb1f4fc2ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:13.919067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41382d2-3869-4ca6-b7c9-cb1f4fc2ffc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:13.919774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41382d2-3869-4ca6-b7c9-cb1f4fc2ffc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:13.921701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41382d2-3869-4ca6-b7c9-cb1f4fc2ffc0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:14.017219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1264/2546] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:13 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:14.021204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe061-0a67-4103-ac35-5dd460408610 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:14.032591 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe061-0a67-4103-ac35-5dd460408610 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:14.087909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f592fae-8635-42d0-a74b-f99174017f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:14.088576 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f592fae-8635-42d0-a74b-f99174017f15 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:14.088859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f592fae-8635-42d0-a74b-f99174017f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:14.089133 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f592fae-8635-42d0-a74b-f99174017f15 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:14.089810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f592fae-8635-42d0-a74b-f99174017f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:14.092059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f592fae-8635-42d0-a74b-f99174017f15 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:14.193500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1283/2547] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:14 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:14.197838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41382d2-3869-4ca6-b7c9-cb1f4fc2ffc0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:14.208073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41382d2-3869-4ca6-b7c9-cb1f4fc2ffc0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:14.213380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990372-5b55-404d-b351-1f39c6811865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:14.214024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990372-5b55-404d-b351-1f39c6811865 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:14.214375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990372-5b55-404d-b351-1f39c6811865 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:14.214628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990372-5b55-404d-b351-1f39c6811865 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:14.215336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990372-5b55-404d-b351-1f39c6811865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:14.216954 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990372-5b55-404d-b351-1f39c6811865 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:14.227311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1265/2548] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:14.231213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f592fae-8635-42d0-a74b-f99174017f15 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:14.241023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f592fae-8635-42d0-a74b-f99174017f15 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:14.245668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be4ec3-f59b-4221-9cfe-b515781259b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:14.246534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be4ec3-f59b-4221-9cfe-b515781259b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:14.246818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be4ec3-f59b-4221-9cfe-b515781259b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:14.247099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be4ec3-f59b-4221-9cfe-b515781259b9 admin admin] PATH_INFO: `/v3/projects/10f23094e3524b1c80b19478fde611ec/users/bcc59b128df24d30bd8caf0accfede72/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:14.261882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be4ec3-f59b-4221-9cfe-b515781259b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f23094e3524b1c80b19478fde611ec, user_id=bcc59b128df24d30bd8caf0accfede72, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:14.264867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be4ec3-f59b-4221-9cfe-b515781259b9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:14.364751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1284/2549] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:14 2022] PUT /identity/v3/projects/10f23094e3524b1c80b19478fde611ec/users/bcc59b128df24d30bd8caf0accfede72/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:14.369322 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990372-5b55-404d-b351-1f39c6811865 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:14.379138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990372-5b55-404d-b351-1f39c6811865 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:14.436816 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13267a6a-c208-44cd-b6a9-fe85160b569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:14.437675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13267a6a-c208-44cd-b6a9-fe85160b569c admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:14.437813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13267a6a-c208-44cd-b6a9-fe85160b569c admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:14.438095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13267a6a-c208-44cd-b6a9-fe85160b569c admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:14.438825 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13267a6a-c208-44cd-b6a9-fe85160b569c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:14.440771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13267a6a-c208-44cd-b6a9-fe85160b569c admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:14.443444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:14.452636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1266/2550] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:14.456730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be4ec3-f59b-4221-9cfe-b515781259b9 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:14.466923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be4ec3-f59b-4221-9cfe-b515781259b9 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:14.471828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc094bd-f788-4232-b1fa-eaaad6285d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:14.472701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc094bd-f788-4232-b1fa-eaaad6285d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:14.472984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc094bd-f788-4232-b1fa-eaaad6285d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:14.473262 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc094bd-f788-4232-b1fa-eaaad6285d48 admin admin] PATH_INFO: `/v3/projects/10f23094e3524b1c80b19478fde611ec/users/bcc59b128df24d30bd8caf0accfede72/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:14.475217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc094bd-f788-4232-b1fa-eaaad6285d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f23094e3524b1c80b19478fde611ec, user_id=bcc59b128df24d30bd8caf0accfede72, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:14.478066 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc094bd-f788-4232-b1fa-eaaad6285d48 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:14.488899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1285/2551] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:14 2022] PUT /identity/v3/projects/10f23094e3524b1c80b19478fde611ec/users/bcc59b128df24d30bd8caf0accfede72/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:14.500249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e3369-8b55-466d-b778-7766acae74a4 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:14.500577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e3369-8b55-466d-b778-7766acae74a4 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:14.500864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e3369-8b55-466d-b778-7766acae74a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:14.530119 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8d6e3369-8b55-466d-b778-7766acae74a4 None None] MFA Rules not processed for user `bcc59b128df24d30bd8caf0accfede72`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:14.531380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8d6e3369-8b55-466d-b778-7766acae74a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:14.603778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1267/2552] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:46:14.614442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc094bd-f788-4232-b1fa-eaaad6285d48 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:14.616342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cbc094bd-f788-4232-b1fa-eaaad6285d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:14.638278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:14.674358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc094bd-f788-4232-b1fa-eaaad6285d48 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:14.678077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcc6c6-9108-4017-96d3-e4c3dd2fe1d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:14.678708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc6c6-9108-4017-96d3-e4c3dd2fe1d2 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:14.678995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc6c6-9108-4017-96d3-e4c3dd2fe1d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:14.679276 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc6c6-9108-4017-96d3-e4c3dd2fe1d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:14.688498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcc6c6-9108-4017-96d3-e4c3dd2fe1d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:14.690061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcc6c6-9108-4017-96d3-e4c3dd2fe1d2 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:14.700055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1286/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:15.216079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e3369-8b55-466d-b778-7766acae74a4 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:15.277467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e3369-8b55-466d-b778-7766acae74a4 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:15.282014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:15.282864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:15.283145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:15.283420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] PATH_INFO: `/v3/users/bfe31fd737074272aef8822ca271896c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:15.284640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe31fd737074272aef8822ca271896c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:15.286538 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:15.474669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe31fd737074272aef8822ca271896c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:15.475242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe31fd737074272aef8822ca271896c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:15.538875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe31fd737074272aef8822ca271896c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:15.546671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe31fd737074272aef8822ca271896c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:15.559006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe31fd737074272aef8822ca271896c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:15.564912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1268/2554] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:15 2022] DELETE /identity/v3/users/bfe31fd737074272aef8822ca271896c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:15.569386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eb3ff-dc28-4cfd-9c6b-e4209c549f97 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:15.569878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eb3ff-dc28-4cfd-9c6b-e4209c549f97 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:15.569977 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eb3ff-dc28-4cfd-9c6b-e4209c549f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:15.587114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-547eb3ff-dc28-4cfd-9c6b-e4209c549f97 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:15.590007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-547eb3ff-dc28-4cfd-9c6b-e4209c549f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:15.648805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1287/2555] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:15.658314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:15.659717 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:15.665035 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:15.718733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652494d-cad3-4068-8188-200202dad608 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:15.722436 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49970ced-215c-43f7-9a43-ad6417ceef21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:15.723084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970ced-215c-43f7-9a43-ad6417ceef21 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:15.723370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970ced-215c-43f7-9a43-ad6417ceef21 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:15.723651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970ced-215c-43f7-9a43-ad6417ceef21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:15.738966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49970ced-215c-43f7-9a43-ad6417ceef21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:15.738966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49970ced-215c-43f7-9a43-ad6417ceef21 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:15.745547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1269/2556] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:16.189539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eb3ff-dc28-4cfd-9c6b-e4209c549f97 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:16.191044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-547eb3ff-dc28-4cfd-9c6b-e4209c549f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:16.203878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eb3ff-dc28-4cfd-9c6b-e4209c549f97 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:16.209474 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:16.210489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:16.210952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:16.211275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] PATH_INFO: `/v3/projects/d4325e9059a3477990b5bf9798c8f61d` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:16.213168 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4325e9059a3477990b5bf9798c8f61d)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:16.215184 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:16.335710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4325e9059a3477990b5bf9798c8f61d', 'request_id': 'req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.342180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4325e9059a3477990b5bf9798c8f61d', 'request_id': 'req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.348810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4325e9059a3477990b5bf9798c8f61d', 'request_id': 'req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.424621 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] The token cache is being invalidate because project d4325e9059a3477990b5bf9798c8f61d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:16.424986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.425674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.427227 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1288/2557] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:16 2022] DELETE /identity/v3/projects/d4325e9059a3477990b5bf9798c8f61d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:16.431127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49970ced-215c-43f7-9a43-ad6417ceef21 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:16.442181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49970ced-215c-43f7-9a43-ad6417ceef21 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:16.500073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:16.500944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:16.501230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:16.501509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] PATH_INFO: `/v3/users/bcc59b128df24d30bd8caf0accfede72` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:16.502691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc59b128df24d30bd8caf0accfede72)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:16.504646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:16.767847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc59b128df24d30bd8caf0accfede72'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.768451 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc59b128df24d30bd8caf0accfede72'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.853952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc59b128df24d30bd8caf0accfede72'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.861692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc59b128df24d30bd8caf0accfede72'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.874127 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-fdc13622-f100-4717-a895-9e3e3ea4f5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc59b128df24d30bd8caf0accfede72'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:16.881782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1270/2558] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:16 2022] DELETE /identity/v3/users/bcc59b128df24d30bd8caf0accfede72 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:17.337680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:17.339389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:17.358998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62b5dd-88db-4b59-ac2c-9d28a3793c6b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:17.403799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:17.419495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:17.421832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:17.421832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:17.421832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] PATH_INFO: `/v3/projects/10f23094e3524b1c80b19478fde611ec` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:17.422934 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f23094e3524b1c80b19478fde611ec)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:17.424898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:17.540958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f23094e3524b1c80b19478fde611ec', 'request_id': 'req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:17.547177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f23094e3524b1c80b19478fde611ec', 'request_id': 'req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:17.553279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f23094e3524b1c80b19478fde611ec', 'request_id': 'req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:17.667409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] The token cache is being invalidate because project 10f23094e3524b1c80b19478fde611ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:17.667629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:17.668280 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-d152c0d5-c5d6-493d-a8fa-bd0477b1bb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:17.669815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1289/2559] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:17 2022] DELETE /identity/v3/projects/10f23094e3524b1c80b19478fde611ec => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:17.674736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadde84-768b-429b-b833-48a982fd2eac None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:17.675185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadde84-768b-429b-b833-48a982fd2eac None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:17.678126 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadde84-768b-429b-b833-48a982fd2eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:17.693131 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-6eadde84-768b-429b-b833-48a982fd2eac None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:17.694356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6eadde84-768b-429b-b833-48a982fd2eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:17.713478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:17.753752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1271/2560] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:17.762159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78910378-e855-4a25-b8c2-1f9eabe7ac7c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:17.762449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78910378-e855-4a25-b8c2-1f9eabe7ac7c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:17.762727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78910378-e855-4a25-b8c2-1f9eabe7ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:17.782103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-78910378-e855-4a25-b8c2-1f9eabe7ac7c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:17.787114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-78910378-e855-4a25-b8c2-1f9eabe7ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:17.791224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1290/2561] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:17.795413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadde84-768b-429b-b833-48a982fd2eac None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:17.805156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadde84-768b-429b-b833-48a982fd2eac None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:17.810337 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60cd45-ff0c-46f0-ae3a-f2ca1c06ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:17.810978 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60cd45-ff0c-46f0-ae3a-f2ca1c06ebb8 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:17.811259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60cd45-ff0c-46f0-ae3a-f2ca1c06ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:17.811530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60cd45-ff0c-46f0-ae3a-f2ca1c06ebb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:17.812274 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60cd45-ff0c-46f0-ae3a-f2ca1c06ebb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:17.812578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60cd45-ff0c-46f0-ae3a-f2ca1c06ebb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:17.814180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60cd45-ff0c-46f0-ae3a-f2ca1c06ebb8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:17.826137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1272/2562] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:17.830564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78910378-e855-4a25-b8c2-1f9eabe7ac7c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:17.840245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78910378-e855-4a25-b8c2-1f9eabe7ac7c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:17.845556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc44c8-5717-4698-8114-9c7cded4063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:17.846200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc44c8-5717-4698-8114-9c7cded4063a admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:17.846483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc44c8-5717-4698-8114-9c7cded4063a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:17.846759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc44c8-5717-4698-8114-9c7cded4063a admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:17.847443 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc44c8-5717-4698-8114-9c7cded4063a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:17.849379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc44c8-5717-4698-8114-9c7cded4063a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:17.927609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1291/2563] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:17 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:17.932166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60cd45-ff0c-46f0-ae3a-f2ca1c06ebb8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:17.942283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60cd45-ff0c-46f0-ae3a-f2ca1c06ebb8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:17.998808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646f3ab-89d1-46cd-ae28-df88c87629d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:17.999476 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646f3ab-89d1-46cd-ae28-df88c87629d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:17.999782 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646f3ab-89d1-46cd-ae28-df88c87629d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:18.000062 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646f3ab-89d1-46cd-ae28-df88c87629d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:18.000750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646f3ab-89d1-46cd-ae28-df88c87629d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:18.002670 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646f3ab-89d1-46cd-ae28-df88c87629d8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:18.075591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1273/2564] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:17 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:46:18.079778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc44c8-5717-4698-8114-9c7cded4063a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:18.090120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc44c8-5717-4698-8114-9c7cded4063a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:18.094943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80688d-0d6f-4425-8957-82fd436195ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:18.095601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80688d-0d6f-4425-8957-82fd436195ba admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:18.096143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80688d-0d6f-4425-8957-82fd436195ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:18.104607 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80688d-0d6f-4425-8957-82fd436195ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:18.104607 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80688d-0d6f-4425-8957-82fd436195ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:18.104607 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80688d-0d6f-4425-8957-82fd436195ba admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:18.109730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1292/2565] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:18.113791 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646f3ab-89d1-46cd-ae28-df88c87629d8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:18.124259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646f3ab-89d1-46cd-ae28-df88c87629d8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:18.128901 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7018b-c4e0-4971-9aa3-1b09a7af3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:18.129557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7018b-c4e0-4971-9aa3-1b09a7af3625 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:18.129845 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7018b-c4e0-4971-9aa3-1b09a7af3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:18.133400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7018b-c4e0-4971-9aa3-1b09a7af3625 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:18.133400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7018b-c4e0-4971-9aa3-1b09a7af3625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:18.133400 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7018b-c4e0-4971-9aa3-1b09a7af3625 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:18.143674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1274/2566] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:18.147963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80688d-0d6f-4425-8957-82fd436195ba admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:18.157978 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80688d-0d6f-4425-8957-82fd436195ba admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:18.162682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db00d4-7999-4884-854b-321a9c7bc4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:18.163550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db00d4-7999-4884-854b-321a9c7bc4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:18.163869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db00d4-7999-4884-854b-321a9c7bc4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:18.164153 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db00d4-7999-4884-854b-321a9c7bc4f3 admin admin] PATH_INFO: `/v3/projects/8cd50b2d059a45c6a3c8879e7009f951/users/ea7c869fda544c52a0ac266e58821313/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:18.179904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db00d4-7999-4884-854b-321a9c7bc4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd50b2d059a45c6a3c8879e7009f951, user_id=ea7c869fda544c52a0ac266e58821313, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:18.184608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db00d4-7999-4884-854b-321a9c7bc4f3 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:18.290200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1293/2567] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:18 2022] PUT /identity/v3/projects/8cd50b2d059a45c6a3c8879e7009f951/users/ea7c869fda544c52a0ac266e58821313/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:46:18.300358 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234fbbf-c226-4ed4-8442-a7a7e89e733f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:18.302261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234fbbf-c226-4ed4-8442-a7a7e89e733f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:18.302261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234fbbf-c226-4ed4-8442-a7a7e89e733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:18.328204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-e234fbbf-c226-4ed4-8442-a7a7e89e733f None None] MFA Rules not processed for user `ea7c869fda544c52a0ac266e58821313`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:18.329434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e234fbbf-c226-4ed4-8442-a7a7e89e733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:18.399034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1275/2568] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:18.409784 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db00d4-7999-4884-854b-321a9c7bc4f3 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:18.411559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-23db00d4-7999-4884-854b-321a9c7bc4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:18.473936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db00d4-7999-4884-854b-321a9c7bc4f3 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:18.479228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606750e6-d979-4827-9c85-d8c935e77bd7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24198f20ebcd4e64a5184fb9fc6764cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:18.479917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606750e6-d979-4827-9c85-d8c935e77bd7 service glance] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:18.480209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606750e6-d979-4827-9c85-d8c935e77bd7 service glance] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:18.480498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606750e6-d979-4827-9c85-d8c935e77bd7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:18.489320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606750e6-d979-4827-9c85-d8c935e77bd7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:18.490767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606750e6-d979-4827-9c85-d8c935e77bd7 service glance] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:18.505989 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1294/2569] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:27.042288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234fbbf-c226-4ed4-8442-a7a7e89e733f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:27.043885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e234fbbf-c226-4ed4-8442-a7a7e89e733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:27.065060 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:27.100733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234fbbf-c226-4ed4-8442-a7a7e89e733f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:27.106047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:27.106849 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:27.107135 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:27.107414 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:27.109507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:27.171014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:27.172478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:27.181950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1276/2570] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:28.501152 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:30.690656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606750e6-d979-4827-9c85-d8c935e77bd7 service glance] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:30.692554 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-606750e6-d979-4827-9c85-d8c935e77bd7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:30.762046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606750e6-d979-4827-9c85-d8c935e77bd7 service glance] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:30.767357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c9cba-b9b4-41e0-9630-573b6d45f9c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:30.768030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c9cba-b9b4-41e0-9630-573b6d45f9c3 service placement] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:30.768317 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c9cba-b9b4-41e0-9630-573b6d45f9c3 service placement] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:30.768599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c9cba-b9b4-41e0-9630-573b6d45f9c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:30.770384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b21c9cba-b9b4-41e0-9630-573b6d45f9c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:30.781714 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c9cba-b9b4-41e0-9630-573b6d45f9c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:30.783389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c9cba-b9b4-41e0-9630-573b6d45f9c3 service placement] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:30.793667 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1295/2571] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:30.831354 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:30.833086 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:30.849242 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83695db-3e51-4445-b8a7-34df78981068 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:30.853663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:30.854537 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:30.854815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:30.855091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] PATH_INFO: `/v3/users/eb6d9398095c426f9d39eef485c45c66` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:30.856305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6d9398095c426f9d39eef485c45c66)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:30.858219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:31.059134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6d9398095c426f9d39eef485c45c66'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.059812 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6d9398095c426f9d39eef485c45c66'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.141072 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6d9398095c426f9d39eef485c45c66'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.148235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6d9398095c426f9d39eef485c45c66'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.159985 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-2bd599b6-b6e0-4d32-af3f-85f1261cd627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6d9398095c426f9d39eef485c45c66'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.165854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1277/2572] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:30 2022] DELETE /identity/v3/users/eb6d9398095c426f9d39eef485c45c66 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:31.445396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c9cba-b9b4-41e0-9630-573b6d45f9c3 service placement] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:31.458103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c9cba-b9b4-41e0-9630-573b6d45f9c3 service placement] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:31.516355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:31.517222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:31.517504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:31.517783 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] PATH_INFO: `/v3/projects/d915343c20044be188d225f96446adf1` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:31.518937 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d915343c20044be188d225f96446adf1)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:31.520877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:31.638671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd915343c20044be188d225f96446adf1', 'request_id': 'req-07b60663-f972-4de9-9e10-c81f2420ec36'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.644105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd915343c20044be188d225f96446adf1', 'request_id': 'req-07b60663-f972-4de9-9e10-c81f2420ec36'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.650100 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd915343c20044be188d225f96446adf1', 'request_id': 'req-07b60663-f972-4de9-9e10-c81f2420ec36'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.757831 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] The token cache is being invalidate because project d915343c20044be188d225f96446adf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:31.758449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.758697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-07b60663-f972-4de9-9e10-c81f2420ec36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:31.760337 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1296/2573] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:31 2022] DELETE /identity/v3/projects/d915343c20044be188d225f96446adf1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:31.765489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbab37-45d4-4be9-9b9c-2fe77afbdff0 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:31.765780 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbab37-45d4-4be9-9b9c-2fe77afbdff0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:31.766081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbab37-45d4-4be9-9b9c-2fe77afbdff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:31.784025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-cecbab37-45d4-4be9-9b9c-2fe77afbdff0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:31.786215 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-cecbab37-45d4-4be9-9b9c-2fe77afbdff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:31.826154 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:31.848002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1278/2574] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:31.855816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684792-5f47-451b-a8b9-2e192abc8a79 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:31.856292 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684792-5f47-451b-a8b9-2e192abc8a79 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:31.856992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684792-5f47-451b-a8b9-2e192abc8a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:31.876313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-65684792-5f47-451b-a8b9-2e192abc8a79 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:31.877527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-65684792-5f47-451b-a8b9-2e192abc8a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:31.886949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1297/2575] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:31.892150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbab37-45d4-4be9-9b9c-2fe77afbdff0 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:31.901237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbab37-45d4-4be9-9b9c-2fe77afbdff0 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:31.906455 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20b0c0-5f26-40ad-af8a-d2d4b4b87165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:31.907133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20b0c0-5f26-40ad-af8a-d2d4b4b87165 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:31.907441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20b0c0-5f26-40ad-af8a-d2d4b4b87165 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:31.907719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20b0c0-5f26-40ad-af8a-d2d4b4b87165 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:31.908473 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20b0c0-5f26-40ad-af8a-d2d4b4b87165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:31.908970 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20b0c0-5f26-40ad-af8a-d2d4b4b87165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:31.910908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20b0c0-5f26-40ad-af8a-d2d4b4b87165 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:31.922779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1279/2576] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:31.927114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65684792-5f47-451b-a8b9-2e192abc8a79 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:31.936287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65684792-5f47-451b-a8b9-2e192abc8a79 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:31.941080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895b891-3bcf-4a31-880a-89c6ec3dff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:31.941717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895b891-3bcf-4a31-880a-89c6ec3dff10 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:31.941997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895b891-3bcf-4a31-880a-89c6ec3dff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:31.942271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895b891-3bcf-4a31-880a-89c6ec3dff10 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:31.942952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895b891-3bcf-4a31-880a-89c6ec3dff10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:31.944921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895b891-3bcf-4a31-880a-89c6ec3dff10 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:31.956024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:32.060559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1298/2577] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:31 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:32.064667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20b0c0-5f26-40ad-af8a-d2d4b4b87165 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:32.074895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20b0c0-5f26-40ad-af8a-d2d4b4b87165 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:32.129752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d132d3-050c-48e3-a152-d53c6a27b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:32.130422 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d132d3-050c-48e3-a152-d53c6a27b3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:32.130710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d132d3-050c-48e3-a152-d53c6a27b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:32.131011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d132d3-050c-48e3-a152-d53c6a27b3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:32.131709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d132d3-050c-48e3-a152-d53c6a27b3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:32.133832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d132d3-050c-48e3-a152-d53c6a27b3d8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:32.232921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1280/2578] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:32 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:32.237450 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895b891-3bcf-4a31-880a-89c6ec3dff10 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:32.249325 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895b891-3bcf-4a31-880a-89c6ec3dff10 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:32.255127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1c0d4-e43c-414f-b130-6213e35725f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:32.255858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1c0d4-e43c-414f-b130-6213e35725f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:32.256353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1c0d4-e43c-414f-b130-6213e35725f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:32.256720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1c0d4-e43c-414f-b130-6213e35725f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:32.257561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1c0d4-e43c-414f-b130-6213e35725f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:32.259495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1c0d4-e43c-414f-b130-6213e35725f6 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:32.271421 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1299/2579] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:32.275486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d132d3-050c-48e3-a152-d53c6a27b3d8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:32.285868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d132d3-050c-48e3-a152-d53c6a27b3d8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:32.290506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf4d5-9362-4923-8344-449b57b7738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:32.293193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf4d5-9362-4923-8344-449b57b7738d admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:32.293193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf4d5-9362-4923-8344-449b57b7738d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:32.293193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf4d5-9362-4923-8344-449b57b7738d admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:32.293193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bf4d5-9362-4923-8344-449b57b7738d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:32.293998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bf4d5-9362-4923-8344-449b57b7738d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:32.304448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1281/2580] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:46:32.309108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1c0d4-e43c-414f-b130-6213e35725f6 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:32.319146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1c0d4-e43c-414f-b130-6213e35725f6 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:32.324453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43389ad5-1ad9-4efd-b861-8e43fb568a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:32.325336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43389ad5-1ad9-4efd-b861-8e43fb568a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:32.325616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43389ad5-1ad9-4efd-b861-8e43fb568a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:32.325890 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43389ad5-1ad9-4efd-b861-8e43fb568a6c admin admin] PATH_INFO: `/v3/projects/c0b2174dc3264fc8b42c691223494d49/users/f8601380b88246e8ae0ce15c5eba4b0b/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:32.340805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43389ad5-1ad9-4efd-b861-8e43fb568a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b2174dc3264fc8b42c691223494d49, user_id=f8601380b88246e8ae0ce15c5eba4b0b, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:32.343479 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43389ad5-1ad9-4efd-b861-8e43fb568a6c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:32.444805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1300/2581] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:32 2022] PUT /identity/v3/projects/c0b2174dc3264fc8b42c691223494d49/users/f8601380b88246e8ae0ce15c5eba4b0b/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:32.456482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a08514-da5a-402a-8ed6-37ada85271d8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:32.456775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a08514-da5a-402a-8ed6-37ada85271d8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:32.457051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a08514-da5a-402a-8ed6-37ada85271d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:32.482860 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-10a08514-da5a-402a-8ed6-37ada85271d8 None None] MFA Rules not processed for user `f8601380b88246e8ae0ce15c5eba4b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:32.484121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-10a08514-da5a-402a-8ed6-37ada85271d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:32.550279 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1282/2582] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:32.562288 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43389ad5-1ad9-4efd-b861-8e43fb568a6c admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:32.563999 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-43389ad5-1ad9-4efd-b861-8e43fb568a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:32.636347 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43389ad5-1ad9-4efd-b861-8e43fb568a6c admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:32.642497 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4645941-da64-47f0-8bdc-992e5ba437af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:32.643141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4645941-da64-47f0-8bdc-992e5ba437af service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:32.643428 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4645941-da64-47f0-8bdc-992e5ba437af service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:32.643709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4645941-da64-47f0-8bdc-992e5ba437af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:32.651573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4645941-da64-47f0-8bdc-992e5ba437af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:32.653201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4645941-da64-47f0-8bdc-992e5ba437af service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:32.662241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1301/2583] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:34.636989 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a08514-da5a-402a-8ed6-37ada85271d8 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:34.638714 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-10a08514-da5a-402a-8ed6-37ada85271d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:34.680285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:34.703788 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a08514-da5a-402a-8ed6-37ada85271d8 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:34.708236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:34.709095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:34.713485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:34.713485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] PATH_INFO: `/v3/users/ea7c869fda544c52a0ac266e58821313` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:34.713485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7c869fda544c52a0ac266e58821313)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:34.713485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:34.939608 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7c869fda544c52a0ac266e58821313'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:34.940343 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7c869fda544c52a0ac266e58821313'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:35.021724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7c869fda544c52a0ac266e58821313'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:35.038410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7c869fda544c52a0ac266e58821313'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:35.050535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7c869fda544c52a0ac266e58821313'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:35.056826 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1283/2584] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:34 2022] DELETE /identity/v3/users/ea7c869fda544c52a0ac266e58821313 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:35.061542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af8c9b-3b8e-45b1-a097-3e0c48deaaa0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:35.062005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af8c9b-3b8e-45b1-a097-3e0c48deaaa0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:35.062096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af8c9b-3b8e-45b1-a097-3e0c48deaaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:35.080750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c4af8c9b-3b8e-45b1-a097-3e0c48deaaa0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:35.081936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c4af8c9b-3b8e-45b1-a097-3e0c48deaaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:35.144827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1302/2585] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:46:35.155359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:35.156781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:35.212930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fa70f-af37-4164-a7dc-1cf825e8399e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:35.219781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136004d-bcd7-4a7e-9a84-af3099edcf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:35.220466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136004d-bcd7-4a7e-9a84-af3099edcf54 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:35.220754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136004d-bcd7-4a7e-9a84-af3099edcf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:35.221026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136004d-bcd7-4a7e-9a84-af3099edcf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:35.230136 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136004d-bcd7-4a7e-9a84-af3099edcf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:35.231596 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136004d-bcd7-4a7e-9a84-af3099edcf54 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:35.240953 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1284/2586] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:35.665888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af8c9b-3b8e-45b1-a097-3e0c48deaaa0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:35.667998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c4af8c9b-3b8e-45b1-a097-3e0c48deaaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:35.680852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af8c9b-3b8e-45b1-a097-3e0c48deaaa0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:35.686124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:35.691275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:35.691275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:35.691275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] PATH_INFO: `/v3/projects/8cd50b2d059a45c6a3c8879e7009f951` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:35.691275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd50b2d059a45c6a3c8879e7009f951)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:35.691275 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:35.793307 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:35.801575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd50b2d059a45c6a3c8879e7009f951', 'request_id': 'req-c88af264-a3cb-4116-8d0d-5364fd35a22f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:35.806752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd50b2d059a45c6a3c8879e7009f951', 'request_id': 'req-c88af264-a3cb-4116-8d0d-5364fd35a22f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:35.813330 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd50b2d059a45c6a3c8879e7009f951', 'request_id': 'req-c88af264-a3cb-4116-8d0d-5364fd35a22f'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:35.906387 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] The token cache is being invalidate because project 8cd50b2d059a45c6a3c8879e7009f951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:35.906683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:35.907353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-c88af264-a3cb-4116-8d0d-5364fd35a22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:35.909008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1303/2587] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:35 2022] DELETE /identity/v3/projects/8cd50b2d059a45c6a3c8879e7009f951 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:35.914162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1ace3-63db-4764-bf41-150a52ad8152 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:35.914595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1ace3-63db-4764-bf41-150a52ad8152 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:35.914771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1ace3-63db-4764-bf41-150a52ad8152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:35.932312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-89e1ace3-63db-4764-bf41-150a52ad8152 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:35.934736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-89e1ace3-63db-4764-bf41-150a52ad8152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:35.983873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:35.992141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1285/2588] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:36.000476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056ea5e-4589-4baf-a125-b90e268ae175 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.000828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056ea5e-4589-4baf-a125-b90e268ae175 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.001113 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056ea5e-4589-4baf-a125-b90e268ae175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.020372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5056ea5e-4589-4baf-a125-b90e268ae175 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:36.021573 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5056ea5e-4589-4baf-a125-b90e268ae175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:36.032047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1304/2589] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:36.036165 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1ace3-63db-4764-bf41-150a52ad8152 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:36.047356 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1ace3-63db-4764-bf41-150a52ad8152 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:36.052010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c44ea1-746a-4c36-929d-4e875a24fdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:36.052662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c44ea1-746a-4c36-929d-4e875a24fdcf admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.052971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c44ea1-746a-4c36-929d-4e875a24fdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.053247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c44ea1-746a-4c36-929d-4e875a24fdcf admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.053961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c44ea1-746a-4c36-929d-4e875a24fdcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:36.054265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c44ea1-746a-4c36-929d-4e875a24fdcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:36.055866 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c44ea1-746a-4c36-929d-4e875a24fdcf admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:36.067984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1286/2590] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:36.072852 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056ea5e-4589-4baf-a125-b90e268ae175 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:36.081696 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056ea5e-4589-4baf-a125-b90e268ae175 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:36.086505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedabaed-0218-47a2-a062-64aeeaff74ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:36.087151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedabaed-0218-47a2-a062-64aeeaff74ee admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.087442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedabaed-0218-47a2-a062-64aeeaff74ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.087719 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedabaed-0218-47a2-a062-64aeeaff74ee admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.088462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedabaed-0218-47a2-a062-64aeeaff74ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:36.091189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedabaed-0218-47a2-a062-64aeeaff74ee admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:36.175349 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1305/2591] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:36 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:36.181401 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c44ea1-746a-4c36-929d-4e875a24fdcf admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:36.186901 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c44ea1-746a-4c36-929d-4e875a24fdcf admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:36.244439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eec746-1b3d-4947-ae93-d57df09e1c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:36.245193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eec746-1b3d-4947-ae93-d57df09e1c75 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.245546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eec746-1b3d-4947-ae93-d57df09e1c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.245899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eec746-1b3d-4947-ae93-d57df09e1c75 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.246652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eec746-1b3d-4947-ae93-d57df09e1c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:36.248606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eec746-1b3d-4947-ae93-d57df09e1c75 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:36.348513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1287/2592] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:36 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:36.349637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedabaed-0218-47a2-a062-64aeeaff74ee admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:36.361427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedabaed-0218-47a2-a062-64aeeaff74ee admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:36.365561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1f6c5-03d7-4f65-a93f-bf2cc5579a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:36.366216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f6c5-03d7-4f65-a93f-bf2cc5579a20 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.366499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f6c5-03d7-4f65-a93f-bf2cc5579a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.366774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f6c5-03d7-4f65-a93f-bf2cc5579a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.367490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1f6c5-03d7-4f65-a93f-bf2cc5579a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:36.369121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1f6c5-03d7-4f65-a93f-bf2cc5579a20 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:36.380001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1306/2593] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:36.383690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eec746-1b3d-4947-ae93-d57df09e1c75 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:36.394352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eec746-1b3d-4947-ae93-d57df09e1c75 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:36.398877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf4e26-5fdd-497f-916f-9b4388f36d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:36.399521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4e26-5fdd-497f-916f-9b4388f36d63 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.399832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4e26-5fdd-497f-916f-9b4388f36d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.400109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4e26-5fdd-497f-916f-9b4388f36d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.400817 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf4e26-5fdd-497f-916f-9b4388f36d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:36.403024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf4e26-5fdd-497f-916f-9b4388f36d63 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:36.412908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1288/2594] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:46:36.416911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1f6c5-03d7-4f65-a93f-bf2cc5579a20 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:36.426697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1f6c5-03d7-4f65-a93f-bf2cc5579a20 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:36.431311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e8b88-4ffe-48e1-ae77-0ae018c56c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:36.432210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e8b88-4ffe-48e1-ae77-0ae018c56c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.432499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e8b88-4ffe-48e1-ae77-0ae018c56c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.432774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e8b88-4ffe-48e1-ae77-0ae018c56c3f admin admin] PATH_INFO: `/v3/projects/174cc9d3ff304c8687536bcbba3435f7/users/c80b75af83ce40979d86854d3c23c21f/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.447157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e8b88-4ffe-48e1-ae77-0ae018c56c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=174cc9d3ff304c8687536bcbba3435f7, user_id=c80b75af83ce40979d86854d3c23c21f, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:36.450340 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e8b88-4ffe-48e1-ae77-0ae018c56c3f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:36.549434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1307/2595] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:36 2022] PUT /identity/v3/projects/174cc9d3ff304c8687536bcbba3435f7/users/c80b75af83ce40979d86854d3c23c21f/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:36.559684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce6080-0885-4519-a9ab-53b02422bbde None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.560008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce6080-0885-4519-a9ab-53b02422bbde None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.560284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce6080-0885-4519-a9ab-53b02422bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.586698 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-5dce6080-0885-4519-a9ab-53b02422bbde None None] MFA Rules not processed for user `c80b75af83ce40979d86854d3c23c21f`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:36.587930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5dce6080-0885-4519-a9ab-53b02422bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:36.650715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1289/2596] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:36.655770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e8b88-4ffe-48e1-ae77-0ae018c56c3f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:36.716911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e8b88-4ffe-48e1-ae77-0ae018c56c3f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:36.721586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e8ab4-6c58-44ea-8f5d-9fa26b0ce6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:36.723447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e8ab4-6c58-44ea-8f5d-9fa26b0ce6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.723447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e8ab4-6c58-44ea-8f5d-9fa26b0ce6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.723447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e8ab4-6c58-44ea-8f5d-9fa26b0ce6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.723447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e8ab4-6c58-44ea-8f5d-9fa26b0ce6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:36.725535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e8ab4-6c58-44ea-8f5d-9fa26b0ce6e3 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:36.811754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1308/2597] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:36 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:36.815706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce6080-0885-4519-a9ab-53b02422bbde None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:36.826900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce6080-0885-4519-a9ab-53b02422bbde None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:36.876009 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:36.883283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3766d-d6dc-426d-9209-03182334a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:36.886561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3766d-d6dc-426d-9209-03182334a5fe admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.886561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3766d-d6dc-426d-9209-03182334a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.886561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3766d-d6dc-426d-9209-03182334a5fe admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.886561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3766d-d6dc-426d-9209-03182334a5fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:36.887715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3766d-d6dc-426d-9209-03182334a5fe admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:36.966793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1290/2598] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:36 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:36.970842 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e8ab4-6c58-44ea-8f5d-9fa26b0ce6e3 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:36.981243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e8ab4-6c58-44ea-8f5d-9fa26b0ce6e3 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:36.985879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4e56-e9de-4a34-9d5f-aa3f565f417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:36.986527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4e56-e9de-4a34-9d5f-aa3f565f417c admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:36.986813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4e56-e9de-4a34-9d5f-aa3f565f417c admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:36.987093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4e56-e9de-4a34-9d5f-aa3f565f417c admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:36.987840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd4e56-e9de-4a34-9d5f-aa3f565f417c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:36.989446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd4e56-e9de-4a34-9d5f-aa3f565f417c admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:37.000604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1309/2599] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:37.004624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3766d-d6dc-426d-9209-03182334a5fe admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:37.015201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3766d-d6dc-426d-9209-03182334a5fe admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:37.019723 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b4126-1ce6-4e50-8ae3-116d57e61184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:37.020599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4126-1ce6-4e50-8ae3-116d57e61184 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:37.020885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4126-1ce6-4e50-8ae3-116d57e61184 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:37.021163 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4126-1ce6-4e50-8ae3-116d57e61184 admin admin] PATH_INFO: `/v3/projects/605b9b7bac7446cca4b9b93277520c62/users/5105bb32ba9d488b80315420e5bccc63/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:37.037671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b4126-1ce6-4e50-8ae3-116d57e61184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605b9b7bac7446cca4b9b93277520c62, user_id=5105bb32ba9d488b80315420e5bccc63, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:37.039466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b4126-1ce6-4e50-8ae3-116d57e61184 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:37.147211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1291/2600] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:37 2022] PUT /identity/v3/projects/605b9b7bac7446cca4b9b93277520c62/users/5105bb32ba9d488b80315420e5bccc63/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:37.151059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4e56-e9de-4a34-9d5f-aa3f565f417c admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:37.161401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4e56-e9de-4a34-9d5f-aa3f565f417c admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:37.195720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:37.219023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f15292-c764-45af-826a-1a8e08e15019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:37.219943 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f15292-c764-45af-826a-1a8e08e15019 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:37.220231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f15292-c764-45af-826a-1a8e08e15019 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:37.220509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f15292-c764-45af-826a-1a8e08e15019 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:37.221231 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f15292-c764-45af-826a-1a8e08e15019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:37.222834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f15292-c764-45af-826a-1a8e08e15019 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:37.232881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1310/2601] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:37.236929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b4126-1ce6-4e50-8ae3-116d57e61184 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:37.247926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b4126-1ce6-4e50-8ae3-116d57e61184 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:37.252746 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010027e-9d72-4ab0-b435-64166ea566d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:37.253619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010027e-9d72-4ab0-b435-64166ea566d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:37.253982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010027e-9d72-4ab0-b435-64166ea566d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:37.254263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010027e-9d72-4ab0-b435-64166ea566d0 admin admin] PATH_INFO: `/v3/projects/605b9b7bac7446cca4b9b93277520c62/users/5105bb32ba9d488b80315420e5bccc63/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:37.256281 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010027e-9d72-4ab0-b435-64166ea566d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605b9b7bac7446cca4b9b93277520c62, user_id=5105bb32ba9d488b80315420e5bccc63, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:37.259091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010027e-9d72-4ab0-b435-64166ea566d0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:37.269539 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1292/2602] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:37 2022] PUT /identity/v3/projects/605b9b7bac7446cca4b9b93277520c62/users/5105bb32ba9d488b80315420e5bccc63/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:37.279979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03631e-67d9-4505-ab97-52cf37ac9331 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:37.280277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03631e-67d9-4505-ab97-52cf37ac9331 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:37.280556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03631e-67d9-4505-ab97-52cf37ac9331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:37.308868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ee03631e-67d9-4505-ab97-52cf37ac9331 None None] MFA Rules not processed for user `5105bb32ba9d488b80315420e5bccc63`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:37.310845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ee03631e-67d9-4505-ab97-52cf37ac9331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:37.383300 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1311/2603] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:46:37.390996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010027e-9d72-4ab0-b435-64166ea566d0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:37.392713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b010027e-9d72-4ab0-b435-64166ea566d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:37.459114 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010027e-9d72-4ab0-b435-64166ea566d0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:37.462786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e4f67-7824-43ad-93d8-96a554e41d97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:37.463426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4f67-7824-43ad-93d8-96a554e41d97 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:37.463709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4f67-7824-43ad-93d8-96a554e41d97 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:37.464551 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4f67-7824-43ad-93d8-96a554e41d97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:37.519846 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4f67-7824-43ad-93d8-96a554e41d97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:37.521305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4f67-7824-43ad-93d8-96a554e41d97 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:37.530420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1293/2604] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:46:38.816438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03631e-67d9-4505-ab97-52cf37ac9331 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:38.816438 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ee03631e-67d9-4505-ab97-52cf37ac9331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:38.879493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03631e-67d9-4505-ab97-52cf37ac9331 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:38.884076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:38.884935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:38.885218 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:38.885493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] PATH_INFO: `/v3/users/f8601380b88246e8ae0ce15c5eba4b0b` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:38.886802 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8601380b88246e8ae0ce15c5eba4b0b)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:38.889042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:39.098469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8601380b88246e8ae0ce15c5eba4b0b'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:39.099109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8601380b88246e8ae0ce15c5eba4b0b'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:39.106498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8601380b88246e8ae0ce15c5eba4b0b'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:39.108995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:39.158190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8601380b88246e8ae0ce15c5eba4b0b'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:39.171853 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8601380b88246e8ae0ce15c5eba4b0b'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:39.177789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1312/2605] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:38 2022] DELETE /identity/v3/users/f8601380b88246e8ae0ce15c5eba4b0b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:39.182430 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38719-b47e-46fc-a91f-2a6bb147c716 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:39.182887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38719-b47e-46fc-a91f-2a6bb147c716 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:39.182995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38719-b47e-46fc-a91f-2a6bb147c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:39.200061 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-19f38719-b47e-46fc-a91f-2a6bb147c716 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:39.201284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-19f38719-b47e-46fc-a91f-2a6bb147c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:39.259278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1294/2606] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:39.269024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:39.270444 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:39.326503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede74cc-430c-4202-bcf0-4d734d67ddac admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:39.330344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5042d1a-f024-40c3-aa3a-05698a6ab072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:39.331442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5042d1a-f024-40c3-aa3a-05698a6ab072 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:39.331722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5042d1a-f024-40c3-aa3a-05698a6ab072 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:39.332019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5042d1a-f024-40c3-aa3a-05698a6ab072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:39.342128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5042d1a-f024-40c3-aa3a-05698a6ab072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:39.343409 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5042d1a-f024-40c3-aa3a-05698a6ab072 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:39.353043 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1313/2607] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:39.743301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38719-b47e-46fc-a91f-2a6bb147c716 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:39.744761 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-19f38719-b47e-46fc-a91f-2a6bb147c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:39.752520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:39.763790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38719-b47e-46fc-a91f-2a6bb147c716 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:39.769781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:39.770842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:39.771169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:39.771357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] PATH_INFO: `/v3/projects/c0b2174dc3264fc8b42c691223494d49` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:39.772639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b2174dc3264fc8b42c691223494d49)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:39.774738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:39.921228 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b2174dc3264fc8b42c691223494d49', 'request_id': 'req-e5155017-8803-4e2a-976a-bc638eaad35e'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:39.927480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b2174dc3264fc8b42c691223494d49', 'request_id': 'req-e5155017-8803-4e2a-976a-bc638eaad35e'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:40.012797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b2174dc3264fc8b42c691223494d49', 'request_id': 'req-e5155017-8803-4e2a-976a-bc638eaad35e'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:40.023960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] The token cache is being invalidate because project c0b2174dc3264fc8b42c691223494d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:40.024441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:40.025090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e5155017-8803-4e2a-976a-bc638eaad35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:40.026647 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1295/2608] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:39 2022] DELETE /identity/v3/projects/c0b2174dc3264fc8b42c691223494d49 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:40.032910 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f2671-ef3b-4efb-a6fc-746ffffce44e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.033369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f2671-ef3b-4efb-a6fc-746ffffce44e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.033462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f2671-ef3b-4efb-a6fc-746ffffce44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.052442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-067f2671-ef3b-4efb-a6fc-746ffffce44e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:40.053638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-067f2671-ef3b-4efb-a6fc-746ffffce44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:40.112872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1314/2609] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:40.121110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240854f3-3667-4cab-a296-eb29adbeb5ee None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.121110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240854f3-3667-4cab-a296-eb29adbeb5ee None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.121110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240854f3-3667-4cab-a296-eb29adbeb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.139909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-240854f3-3667-4cab-a296-eb29adbeb5ee None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:40.141095 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-240854f3-3667-4cab-a296-eb29adbeb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:40.149718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1296/2610] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:40.153872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f2671-ef3b-4efb-a6fc-746ffffce44e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:40.163889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f2671-ef3b-4efb-a6fc-746ffffce44e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:40.169615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400672f-6964-4cbf-92b1-abddd2ab12a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:40.170272 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400672f-6964-4cbf-92b1-abddd2ab12a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.170560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400672f-6964-4cbf-92b1-abddd2ab12a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.170841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400672f-6964-4cbf-92b1-abddd2ab12a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.171589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400672f-6964-4cbf-92b1-abddd2ab12a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:40.171930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400672f-6964-4cbf-92b1-abddd2ab12a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:40.173541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400672f-6964-4cbf-92b1-abddd2ab12a4 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:40.186120 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1315/2611] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:40.190015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240854f3-3667-4cab-a296-eb29adbeb5ee None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:40.199196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240854f3-3667-4cab-a296-eb29adbeb5ee None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:40.203895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfaaa1-664e-4960-bdb7-786d44b75a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:40.204536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfaaa1-664e-4960-bdb7-786d44b75a24 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.204815 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfaaa1-664e-4960-bdb7-786d44b75a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.205090 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfaaa1-664e-4960-bdb7-786d44b75a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.205764 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfaaa1-664e-4960-bdb7-786d44b75a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:40.207680 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfaaa1-664e-4960-bdb7-786d44b75a24 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:40.308404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1297/2612] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:40 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:40.312480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400672f-6964-4cbf-92b1-abddd2ab12a4 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:40.322528 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400672f-6964-4cbf-92b1-abddd2ab12a4 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:40.377676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240573-6480-4a85-978c-c6ebe961d841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:40.378302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240573-6480-4a85-978c-c6ebe961d841 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.378586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240573-6480-4a85-978c-c6ebe961d841 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.378864 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240573-6480-4a85-978c-c6ebe961d841 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.379553 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8240573-6480-4a85-978c-c6ebe961d841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:40.381620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8240573-6480-4a85-978c-c6ebe961d841 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:40.391384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:40.504243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1316/2613] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:40 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:40.508501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfaaa1-664e-4960-bdb7-786d44b75a24 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:40.518853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfaaa1-664e-4960-bdb7-786d44b75a24 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:40.523833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e293910-1d72-4619-8e49-92870226d8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:40.524487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e293910-1d72-4619-8e49-92870226d8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.524769 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e293910-1d72-4619-8e49-92870226d8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.525048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e293910-1d72-4619-8e49-92870226d8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.525794 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e293910-1d72-4619-8e49-92870226d8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:40.527895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e293910-1d72-4619-8e49-92870226d8f1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:40.538312 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1298/2614] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:40.542125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240573-6480-4a85-978c-c6ebe961d841 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:40.552327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240573-6480-4a85-978c-c6ebe961d841 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:40.556893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb58a7a-bcca-4611-bfc8-0d64621586b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:40.557535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58a7a-bcca-4611-bfc8-0d64621586b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.557819 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58a7a-bcca-4611-bfc8-0d64621586b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.558092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58a7a-bcca-4611-bfc8-0d64621586b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.558801 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb58a7a-bcca-4611-bfc8-0d64621586b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:40.560415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb58a7a-bcca-4611-bfc8-0d64621586b1 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:40.571106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1317/2615] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:40.575093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e293910-1d72-4619-8e49-92870226d8f1 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:40.584810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e293910-1d72-4619-8e49-92870226d8f1 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:40.589324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0d982-ff3b-44e1-9c9a-7dd0623260e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:40.590678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0d982-ff3b-44e1-9c9a-7dd0623260e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.590959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0d982-ff3b-44e1-9c9a-7dd0623260e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.591232 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0d982-ff3b-44e1-9c9a-7dd0623260e7 admin admin] PATH_INFO: `/v3/projects/41858f53d1584f0ebcb6fff2ec0f3a1f/users/64c43ef0c4564403aff5bf8dced23193/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.606225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0d982-ff3b-44e1-9c9a-7dd0623260e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41858f53d1584f0ebcb6fff2ec0f3a1f, user_id=64c43ef0c4564403aff5bf8dced23193, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:40.608897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0d982-ff3b-44e1-9c9a-7dd0623260e7 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:40.673865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1299/2616] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:40 2022] PUT /identity/v3/projects/41858f53d1584f0ebcb6fff2ec0f3a1f/users/64c43ef0c4564403aff5bf8dced23193/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:40.685725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e20b5-9b6b-484a-9b6f-8220f11cca2b None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.685990 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e20b5-9b6b-484a-9b6f-8220f11cca2b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.686274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e20b5-9b6b-484a-9b6f-8220f11cca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.690701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0d982-ff3b-44e1-9c9a-7dd0623260e7 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:40.692606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3dc0d982-ff3b-44e1-9c9a-7dd0623260e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:40.713448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c11e20b5-9b6b-484a-9b6f-8220f11cca2b None None] MFA Rules not processed for user `64c43ef0c4564403aff5bf8dced23193`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:40.714649 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c11e20b5-9b6b-484a-9b6f-8220f11cca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:40.756172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0d982-ff3b-44e1-9c9a-7dd0623260e7 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:40.760945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:40.761966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.762249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.762686 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] PATH_INFO: `/v3/users/c80b75af83ce40979d86854d3c23c21f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.764022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80b75af83ce40979d86854d3c23c21f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:40.765921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:40.781713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1318/2617] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:40.786187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e20b5-9b6b-484a-9b6f-8220f11cca2b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:40.790931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:40.797578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e20b5-9b6b-484a-9b6f-8220f11cca2b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:40.802288 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4b106-f3a0-4d21-92a5-b031d945b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:40.802960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4b106-f3a0-4d21-92a5-b031d945b0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.803245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4b106-f3a0-4d21-92a5-b031d945b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.803524 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4b106-f3a0-4d21-92a5-b031d945b0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.804243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4b106-f3a0-4d21-92a5-b031d945b0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:40.806177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4b106-f3a0-4d21-92a5-b031d945b0b2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:40.900202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1319/2618] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:40 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:46:40.904053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4b106-f3a0-4d21-92a5-b031d945b0b2 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:40.962679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4b106-f3a0-4d21-92a5-b031d945b0b2 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:40.967909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c905bc-e5e7-4209-aecb-1edb27b6249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:40.968566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c905bc-e5e7-4209-aecb-1edb27b6249f admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:40.968851 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c905bc-e5e7-4209-aecb-1edb27b6249f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:40.969131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c905bc-e5e7-4209-aecb-1edb27b6249f admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:40.969805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c905bc-e5e7-4209-aecb-1edb27b6249f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:40.971720 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c905bc-e5e7-4209-aecb-1edb27b6249f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:41.038573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80b75af83ce40979d86854d3c23c21f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:41.039388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80b75af83ce40979d86854d3c23c21f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:41.067498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1320/2619] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:40 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:46:41.071252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c905bc-e5e7-4209-aecb-1edb27b6249f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:41.082115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c905bc-e5e7-4209-aecb-1edb27b6249f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:41.086805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c06af-4015-45ea-9b40-15bcfd385d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:41.087544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c06af-4015-45ea-9b40-15bcfd385d87 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:41.087858 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c06af-4015-45ea-9b40-15bcfd385d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:41.088140 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c06af-4015-45ea-9b40-15bcfd385d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:41.088848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c06af-4015-45ea-9b40-15bcfd385d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:41.091591 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c06af-4015-45ea-9b40-15bcfd385d87 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:41.101750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1321/2620] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:46:41.112339 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c06af-4015-45ea-9b40-15bcfd385d87 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:41.121883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c06af-4015-45ea-9b40-15bcfd385d87 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:41.124166 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80b75af83ce40979d86854d3c23c21f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:41.126565 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353a83c-1422-4ac6-a7dc-b065bfcb0215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:41.127408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353a83c-1422-4ac6-a7dc-b065bfcb0215 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:41.127692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353a83c-1422-4ac6-a7dc-b065bfcb0215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:41.127992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353a83c-1422-4ac6-a7dc-b065bfcb0215 admin admin] PATH_INFO: `/v3/projects/57d94bed039e43d2a4a64956507477be/users/af3923983c92496a9690f7aebf5d2c0c/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:41.131789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80b75af83ce40979d86854d3c23c21f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:41.145055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353a83c-1422-4ac6-a7dc-b065bfcb0215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d94bed039e43d2a4a64956507477be, user_id=af3923983c92496a9690f7aebf5d2c0c, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:41.145211 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ee30687a-ea13-41ec-9dc0-c22330429401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80b75af83ce40979d86854d3c23c21f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:41.147490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353a83c-1422-4ac6-a7dc-b065bfcb0215 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:41.150822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1300/2621] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:40 2022] DELETE /identity/v3/users/c80b75af83ce40979d86854d3c23c21f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:41.155801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334ba77-a2e4-4409-b7fe-769b12e01bf7 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:41.156097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334ba77-a2e4-4409-b7fe-769b12e01bf7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:41.156378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334ba77-a2e4-4409-b7fe-769b12e01bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:41.173209 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9334ba77-a2e4-4409-b7fe-769b12e01bf7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:41.174460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9334ba77-a2e4-4409-b7fe-769b12e01bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:41.216023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1322/2622] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:41 2022] PUT /identity/v3/projects/57d94bed039e43d2a4a64956507477be/users/af3923983c92496a9690f7aebf5d2c0c/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:46:41.219974 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353a83c-1422-4ac6-a7dc-b065bfcb0215 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:41.221587 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e353a83c-1422-4ac6-a7dc-b065bfcb0215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:41.230786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:41.232726 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1301/2623] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:46:41.242338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334ba77-a2e4-4409-b7fe-769b12e01bf7 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:41.243678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9334ba77-a2e4-4409-b7fe-769b12e01bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:41.285790 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353a83c-1422-4ac6-a7dc-b065bfcb0215 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:41.290556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabb490-410d-4523-b19a-4aec36e03a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:41.291222 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb490-410d-4523-b19a-4aec36e03a7a admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:41.291506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb490-410d-4523-b19a-4aec36e03a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:41.291810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb490-410d-4523-b19a-4aec36e03a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:41.292527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabb490-410d-4523-b19a-4aec36e03a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:41.294193 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabb490-410d-4523-b19a-4aec36e03a7a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:41.301289 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334ba77-a2e4-4409-b7fe-769b12e01bf7 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:41.307531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1323/2624] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:46:41.309169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabb490-410d-4523-b19a-4aec36e03a7a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:41.318929 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabb490-410d-4523-b19a-4aec36e03a7a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:41.323680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988e859-92ba-4412-8b92-5d1c60e53625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:41.325146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e859-92ba-4412-8b92-5d1c60e53625 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:41.325430 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e859-92ba-4412-8b92-5d1c60e53625 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:41.325705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e859-92ba-4412-8b92-5d1c60e53625 admin admin] PATH_INFO: `/v3/projects/57d94bed039e43d2a4a64956507477be/users/af3923983c92496a9690f7aebf5d2c0c/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:41.327692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988e859-92ba-4412-8b92-5d1c60e53625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d94bed039e43d2a4a64956507477be, user_id=af3923983c92496a9690f7aebf5d2c0c, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:41.330389 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988e859-92ba-4412-8b92-5d1c60e53625 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:41.341053 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1324/2625] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:41 2022] PUT /identity/v3/projects/57d94bed039e43d2a4a64956507477be/users/af3923983c92496a9690f7aebf5d2c0c/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:41.350591 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf900-4d39-49c5-a7d1-61d0ce13d16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:41.351282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4681d0-ee25-40e8-819e-a2b329785886 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:41.351431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf900-4d39-49c5-a7d1-61d0ce13d16c service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:41.351585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4681d0-ee25-40e8-819e-a2b329785886 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:41.351700 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf900-4d39-49c5-a7d1-61d0ce13d16c service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:41.351899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf900-4d39-49c5-a7d1-61d0ce13d16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:41.352000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4681d0-ee25-40e8-819e-a2b329785886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:41.361221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebf900-4d39-49c5-a7d1-61d0ce13d16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:41.367874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebf900-4d39-49c5-a7d1-61d0ce13d16c service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:41.367874 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:41.373117 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1302/2626] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:46:41.379343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-ce4681d0-ee25-40e8-819e-a2b329785886 None None] MFA Rules not processed for user `af3923983c92496a9690f7aebf5d2c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:41.380604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ce4681d0-ee25-40e8-819e-a2b329785886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:41.448432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1325/2627] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:46:41.459762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf900-4d39-49c5-a7d1-61d0ce13d16c service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:41.461287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-64ebf900-4d39-49c5-a7d1-61d0ce13d16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:41.523777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf900-4d39-49c5-a7d1-61d0ce13d16c service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:41.576630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550969b-cf48-4326-8344-18746e31238e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:41.577284 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550969b-cf48-4326-8344-18746e31238e service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:41.577570 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550969b-cf48-4326-8344-18746e31238e service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:41.577844 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550969b-cf48-4326-8344-18746e31238e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:41.587137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550969b-cf48-4326-8344-18746e31238e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:41.589059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550969b-cf48-4326-8344-18746e31238e service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:41.599276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1303/2628] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:41.788531 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4681d0-ee25-40e8-819e-a2b329785886 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:41.791945 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-ce4681d0-ee25-40e8-819e-a2b329785886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:41.857139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4681d0-ee25-40e8-819e-a2b329785886 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:41.861671 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:41.862521 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:41.862798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:41.863076 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] PATH_INFO: `/v3/projects/174cc9d3ff304c8687536bcbba3435f7` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:41.864299 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=174cc9d3ff304c8687536bcbba3435f7)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:41.866202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:41.882772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:41.982640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174cc9d3ff304c8687536bcbba3435f7', 'request_id': 'req-4e033dee-680c-4470-a4e5-e3769863d6a7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:41.988018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174cc9d3ff304c8687536bcbba3435f7', 'request_id': 'req-4e033dee-680c-4470-a4e5-e3769863d6a7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:41.994183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174cc9d3ff304c8687536bcbba3435f7', 'request_id': 'req-4e033dee-680c-4470-a4e5-e3769863d6a7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:42.087806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] The token cache is being invalidate because project 174cc9d3ff304c8687536bcbba3435f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:42.088411 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:42.088713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:42.090783 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1326/2629] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:41 2022] DELETE /identity/v3/projects/174cc9d3ff304c8687536bcbba3435f7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:42.094963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550969b-cf48-4326-8344-18746e31238e service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:42.106514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550969b-cf48-4326-8344-18746e31238e service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:42.163865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:42.164641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:42.164929 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:42.165210 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] PATH_INFO: `/v3/users/5105bb32ba9d488b80315420e5bccc63` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:42.166406 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5105bb32ba9d488b80315420e5bccc63)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:42.168489 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:42.366171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5105bb32ba9d488b80315420e5bccc63'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:42.366809 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5105bb32ba9d488b80315420e5bccc63'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:42.435984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5105bb32ba9d488b80315420e5bccc63'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:42.442098 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:42.444256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5105bb32ba9d488b80315420e5bccc63'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:42.456017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-19b0a4b0-684d-4441-8cce-1895e0d9b375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5105bb32ba9d488b80315420e5bccc63'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:42.461951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1304/2630] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:42 2022] DELETE /identity/v3/users/5105bb32ba9d488b80315420e5bccc63 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:42.916778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:42.918867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:42.933963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033dee-680c-4470-a4e5-e3769863d6a7 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:43.005563 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:43.006398 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:43.006681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:43.006960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] PATH_INFO: `/v3/projects/605b9b7bac7446cca4b9b93277520c62` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:43.008618 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605b9b7bac7446cca4b9b93277520c62)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:43.010523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:43.114713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605b9b7bac7446cca4b9b93277520c62', 'request_id': 'req-429a93f5-5b83-41b0-bc47-78cca979ae66'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:43.120263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605b9b7bac7446cca4b9b93277520c62', 'request_id': 'req-429a93f5-5b83-41b0-bc47-78cca979ae66'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:43.126447 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605b9b7bac7446cca4b9b93277520c62', 'request_id': 'req-429a93f5-5b83-41b0-bc47-78cca979ae66'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:43.207871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] The token cache is being invalidate because project 605b9b7bac7446cca4b9b93277520c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:43.208165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:43.213119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-429a93f5-5b83-41b0-bc47-78cca979ae66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:43.213119 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1327/2631] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:42 2022] DELETE /identity/v3/projects/605b9b7bac7446cca4b9b93277520c62 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:43.217447 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0dfca-7510-4305-a5cb-32307367a64f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:43.217743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0dfca-7510-4305-a5cb-32307367a64f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:43.218024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0dfca-7510-4305-a5cb-32307367a64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:43.235906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-add0dfca-7510-4305-a5cb-32307367a64f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:43.237140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-add0dfca-7510-4305-a5cb-32307367a64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:43.299123 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1305/2632] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:43.308070 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e8e3-877e-4c15-852c-b7160d85a5b7 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:43.308455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e8e3-877e-4c15-852c-b7160d85a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:43.308785 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e8e3-877e-4c15-852c-b7160d85a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:43.327360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-9e00e8e3-877e-4c15-852c-b7160d85a5b7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:43.328713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9e00e8e3-877e-4c15-852c-b7160d85a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:43.336822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1328/2633] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:43.346523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0dfca-7510-4305-a5cb-32307367a64f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:43.357080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0dfca-7510-4305-a5cb-32307367a64f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:43.362652 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b82ab-ce8d-4e2b-be38-12c4a2499324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:43.365399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b82ab-ce8d-4e2b-be38-12c4a2499324 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:43.365399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b82ab-ce8d-4e2b-be38-12c4a2499324 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:43.365399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b82ab-ce8d-4e2b-be38-12c4a2499324 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:43.365399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b82ab-ce8d-4e2b-be38-12c4a2499324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:43.365399 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b82ab-ce8d-4e2b-be38-12c4a2499324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:43.366595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b82ab-ce8d-4e2b-be38-12c4a2499324 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:43.378535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1306/2634] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:43.382984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00e8e3-877e-4c15-852c-b7160d85a5b7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:43.393033 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00e8e3-877e-4c15-852c-b7160d85a5b7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:43.397677 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8007e07-42a5-463c-96b0-958cca5782ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:43.398324 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8007e07-42a5-463c-96b0-958cca5782ef admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:43.398611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8007e07-42a5-463c-96b0-958cca5782ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:43.398889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8007e07-42a5-463c-96b0-958cca5782ef admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:43.399582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8007e07-42a5-463c-96b0-958cca5782ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:43.401551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8007e07-42a5-463c-96b0-958cca5782ef admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:43.521331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1329/2635] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:43 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:46:43.525366 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b82ab-ce8d-4e2b-be38-12c4a2499324 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:43.535909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b82ab-ce8d-4e2b-be38-12c4a2499324 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:43.593809 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c46851-ab0e-4d0f-ba28-c697bcd11ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:43.594471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c46851-ab0e-4d0f-ba28-c697bcd11ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:43.594754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c46851-ab0e-4d0f-ba28-c697bcd11ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:43.595031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c46851-ab0e-4d0f-ba28-c697bcd11ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:43.595702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c46851-ab0e-4d0f-ba28-c697bcd11ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:43.597648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c46851-ab0e-4d0f-ba28-c697bcd11ae0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:43.716544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1307/2636] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:43 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:43.720761 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8007e07-42a5-463c-96b0-958cca5782ef admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:43.730941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8007e07-42a5-463c-96b0-958cca5782ef admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:43.735902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1955f-fe70-47f5-b042-452c04c5b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:43.736561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1955f-fe70-47f5-b042-452c04c5b928 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:43.736919 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1955f-fe70-47f5-b042-452c04c5b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:43.737204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1955f-fe70-47f5-b042-452c04c5b928 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:43.737923 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1955f-fe70-47f5-b042-452c04c5b928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:43.739562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1955f-fe70-47f5-b042-452c04c5b928 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:43.740903 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:43.750953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1330/2637] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:46:43.754751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c46851-ab0e-4d0f-ba28-c697bcd11ae0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:43.765485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c46851-ab0e-4d0f-ba28-c697bcd11ae0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:43.770162 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c6e97-ada0-48b0-9704-77dace8ca225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:43.770807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c6e97-ada0-48b0-9704-77dace8ca225 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:43.771089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c6e97-ada0-48b0-9704-77dace8ca225 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:43.771407 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c6e97-ada0-48b0-9704-77dace8ca225 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:43.772156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c6e97-ada0-48b0-9704-77dace8ca225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:43.773734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c6e97-ada0-48b0-9704-77dace8ca225 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:43.784109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1308/2638] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:43.788181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1955f-fe70-47f5-b042-452c04c5b928 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:43.799824 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1955f-fe70-47f5-b042-452c04c5b928 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:43.804606 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1e181-93e4-4d57-86bb-b28aa22338db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:43.805577 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1e181-93e4-4d57-86bb-b28aa22338db admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:43.805938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1e181-93e4-4d57-86bb-b28aa22338db admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:43.806277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1e181-93e4-4d57-86bb-b28aa22338db admin admin] PATH_INFO: `/v3/projects/6ddce30006bd454b90d99dd91f530da3/users/97b604a0839b42489ed8366d859b21c5/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:43.822921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1e181-93e4-4d57-86bb-b28aa22338db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddce30006bd454b90d99dd91f530da3, user_id=97b604a0839b42489ed8366d859b21c5, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:43.826195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1e181-93e4-4d57-86bb-b28aa22338db admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:44.007437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1331/2639] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:43 2022] PUT /identity/v3/projects/6ddce30006bd454b90d99dd91f530da3/users/97b604a0839b42489ed8366d859b21c5/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:44.018294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33347082-dd16-47d5-ba6e-f5dabc539fb8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:44.018580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33347082-dd16-47d5-ba6e-f5dabc539fb8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:44.018885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33347082-dd16-47d5-ba6e-f5dabc539fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:44.046471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-33347082-dd16-47d5-ba6e-f5dabc539fb8 None None] MFA Rules not processed for user `97b604a0839b42489ed8366d859b21c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:44.047691 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-33347082-dd16-47d5-ba6e-f5dabc539fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:44.080186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:44.116902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1309/2640] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:44.125426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1e181-93e4-4d57-86bb-b28aa22338db admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:44.127868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-dae1e181-93e4-4d57-86bb-b28aa22338db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:44.185787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1e181-93e4-4d57-86bb-b28aa22338db admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:44.189440 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb939b0-b29d-4fde-b50f-78fc413e4aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:44.190117 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb939b0-b29d-4fde-b50f-78fc413e4aad service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:44.190422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb939b0-b29d-4fde-b50f-78fc413e4aad service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:44.190698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb939b0-b29d-4fde-b50f-78fc413e4aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:44.198814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb939b0-b29d-4fde-b50f-78fc413e4aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:44.200866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb939b0-b29d-4fde-b50f-78fc413e4aad service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:44.209721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1332/2641] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:44.540589 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33347082-dd16-47d5-ba6e-f5dabc539fb8 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:44.541996 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-33347082-dd16-47d5-ba6e-f5dabc539fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:44.607546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33347082-dd16-47d5-ba6e-f5dabc539fb8 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:44.612152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:44.613014 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:44.613299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:44.613604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] PATH_INFO: `/v3/users/64c43ef0c4564403aff5bf8dced23193` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:44.614792 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c43ef0c4564403aff5bf8dced23193)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:44.616878 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:44.789058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c43ef0c4564403aff5bf8dced23193'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:44.789660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c43ef0c4564403aff5bf8dced23193'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:44.850178 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c43ef0c4564403aff5bf8dced23193'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:44.863765 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c43ef0c4564403aff5bf8dced23193'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:44.869853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c43ef0c4564403aff5bf8dced23193'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:44.876497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1310/2642] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:44 2022] DELETE /identity/v3/users/64c43ef0c4564403aff5bf8dced23193 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:44.881397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e26e-c95d-4730-86f2-364b7491b17d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:44.881771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e26e-c95d-4730-86f2-364b7491b17d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:44.882129 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e26e-c95d-4730-86f2-364b7491b17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:44.900454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-9e42e26e-c95d-4730-86f2-364b7491b17d None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:44.901640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9e42e26e-c95d-4730-86f2-364b7491b17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:44.962551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1333/2643] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:44.972186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:44.973635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:45.032858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c272f-cde3-4e7f-99a1-3c667cec99c3 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:45.036545 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d976f5-5937-4021-90a5-8fd36896a36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:45.038573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d976f5-5937-4021-90a5-8fd36896a36a service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:45.038573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d976f5-5937-4021-90a5-8fd36896a36a service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:45.038573 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d976f5-5937-4021-90a5-8fd36896a36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:45.046205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:45.047581 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d976f5-5937-4021-90a5-8fd36896a36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:45.049134 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d976f5-5937-4021-90a5-8fd36896a36a service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:45.060019 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1311/2644] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:45.440741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42e26e-c95d-4730-86f2-364b7491b17d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:45.442357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9e42e26e-c95d-4730-86f2-364b7491b17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:45.454748 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42e26e-c95d-4730-86f2-364b7491b17d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:45.459349 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:45.464808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:45.464808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:45.464808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] PATH_INFO: `/v3/projects/41858f53d1584f0ebcb6fff2ec0f3a1f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:45.464808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41858f53d1584f0ebcb6fff2ec0f3a1f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:45.464808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:45.565022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41858f53d1584f0ebcb6fff2ec0f3a1f', 'request_id': 'req-4baafedd-06f0-4629-a5ec-26330e950535'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:45.570449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41858f53d1584f0ebcb6fff2ec0f3a1f', 'request_id': 'req-4baafedd-06f0-4629-a5ec-26330e950535'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:45.576703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41858f53d1584f0ebcb6fff2ec0f3a1f', 'request_id': 'req-4baafedd-06f0-4629-a5ec-26330e950535'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:45.662166 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:45.666871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] The token cache is being invalidate because project 41858f53d1584f0ebcb6fff2ec0f3a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:45.667183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:45.667820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4baafedd-06f0-4629-a5ec-26330e950535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:45.669967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1334/2645] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:45 2022] DELETE /identity/v3/projects/41858f53d1584f0ebcb6fff2ec0f3a1f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:45.674054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d976f5-5937-4021-90a5-8fd36896a36a service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:45.683897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d976f5-5937-4021-90a5-8fd36896a36a service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:45.776129 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:45.777037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:45.777316 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:45.777594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] PATH_INFO: `/v3/users/af3923983c92496a9690f7aebf5d2c0c` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:45.779261 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3923983c92496a9690f7aebf5d2c0c)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:45.781314 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:45.919642 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487101-b9e5-47c1-8bfd-df14563c0ca5 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:45.920001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487101-b9e5-47c1-8bfd-df14563c0ca5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:45.920282 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487101-b9e5-47c1-8bfd-df14563c0ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:45.937855 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-63487101-b9e5-47c1-8bfd-df14563c0ca5 None None] MFA Rules not processed for user `97b604a0839b42489ed8366d859b21c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:45.939130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-63487101-b9e5-47c1-8bfd-df14563c0ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:45.947005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3923983c92496a9690f7aebf5d2c0c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:45.947766 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3923983c92496a9690f7aebf5d2c0c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:45.994241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1335/2646] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:46:46.018112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3923983c92496a9690f7aebf5d2c0c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:46.025713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3923983c92496a9690f7aebf5d2c0c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:46.039315 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bf1cdb68-f9cc-425d-9181-6570077dfcbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3923983c92496a9690f7aebf5d2c0c'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:46.046293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1312/2647] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:45 2022] DELETE /identity/v3/users/af3923983c92496a9690f7aebf5d2c0c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:46.451998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63487101-b9e5-47c1-8bfd-df14563c0ca5 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:46.453433 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-63487101-b9e5-47c1-8bfd-df14563c0ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:46.471352 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63487101-b9e5-47c1-8bfd-df14563c0ca5 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:46.529054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:46.529905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:46.534736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:46.534736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] PATH_INFO: `/v3/projects/57d94bed039e43d2a4a64956507477be` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:46.534736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d94bed039e43d2a4a64956507477be)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:46.534736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:46.645765 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d94bed039e43d2a4a64956507477be', 'request_id': 'req-1a8e8aa2-3814-480b-8962-5035dee3a2e6'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:46.651759 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d94bed039e43d2a4a64956507477be', 'request_id': 'req-1a8e8aa2-3814-480b-8962-5035dee3a2e6'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:46.659061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d94bed039e43d2a4a64956507477be', 'request_id': 'req-1a8e8aa2-3814-480b-8962-5035dee3a2e6'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:46.829077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] The token cache is being invalidate because project 57d94bed039e43d2a4a64956507477be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:46.831145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:46.831145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-1a8e8aa2-3814-480b-8962-5035dee3a2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:46.831637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1336/2648] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:46 2022] DELETE /identity/v3/projects/57d94bed039e43d2a4a64956507477be => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:46.836434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341532-7486-4c4d-91dd-c330064f83e9 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:46.836903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341532-7486-4c4d-91dd-c330064f83e9 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:46.837042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341532-7486-4c4d-91dd-c330064f83e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:46.855193 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b1341532-7486-4c4d-91dd-c330064f83e9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:46.856584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b1341532-7486-4c4d-91dd-c330064f83e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:46.914571 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1313/2649] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:46.922228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61912cf7-73a1-472e-a495-7fc4e27269e1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:46.922519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61912cf7-73a1-472e-a495-7fc4e27269e1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:46.922800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61912cf7-73a1-472e-a495-7fc4e27269e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:46.940652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-61912cf7-73a1-472e-a495-7fc4e27269e1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:46.941834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-61912cf7-73a1-472e-a495-7fc4e27269e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:46.950969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1337/2650] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:46.955175 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341532-7486-4c4d-91dd-c330064f83e9 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:46.964852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341532-7486-4c4d-91dd-c330064f83e9 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:46.970031 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa47a5-83d8-47cc-8b3c-94e0743597ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:46.970677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa47a5-83d8-47cc-8b3c-94e0743597ed admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:46.971227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa47a5-83d8-47cc-8b3c-94e0743597ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:46.971227 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa47a5-83d8-47cc-8b3c-94e0743597ed admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:46.971963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa47a5-83d8-47cc-8b3c-94e0743597ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:46.972278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa47a5-83d8-47cc-8b3c-94e0743597ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:46.973869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa47a5-83d8-47cc-8b3c-94e0743597ed admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:46.985465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1314/2651] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:46.989772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61912cf7-73a1-472e-a495-7fc4e27269e1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:46.998913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61912cf7-73a1-472e-a495-7fc4e27269e1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:47.003513 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da16e2-1c60-401b-81a4-92c1c9e0c0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:47.004186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da16e2-1c60-401b-81a4-92c1c9e0c0da admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:47.004468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da16e2-1c60-401b-81a4-92c1c9e0c0da admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:47.004738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da16e2-1c60-401b-81a4-92c1c9e0c0da admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:47.005414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da16e2-1c60-401b-81a4-92c1c9e0c0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:47.007296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da16e2-1c60-401b-81a4-92c1c9e0c0da admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:47.091820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1338/2652] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:46 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:47.092566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa47a5-83d8-47cc-8b3c-94e0743597ed admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:47.097771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:47.103051 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa47a5-83d8-47cc-8b3c-94e0743597ed admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:47.159980 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f189a21-d186-46a2-9d9b-656c87a86637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:47.160738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f189a21-d186-46a2-9d9b-656c87a86637 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:47.161058 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f189a21-d186-46a2-9d9b-656c87a86637 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:47.161368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f189a21-d186-46a2-9d9b-656c87a86637 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:47.162059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f189a21-d186-46a2-9d9b-656c87a86637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:47.164006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f189a21-d186-46a2-9d9b-656c87a86637 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:47.253869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1315/2653] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:47 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:46:47.257928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da16e2-1c60-401b-81a4-92c1c9e0c0da admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:47.264849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:47.268905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da16e2-1c60-401b-81a4-92c1c9e0c0da admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:47.273550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd942a-3e57-4c5c-b16e-c0776c68047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:47.274204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd942a-3e57-4c5c-b16e-c0776c68047f admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:47.274483 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd942a-3e57-4c5c-b16e-c0776c68047f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:47.274755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd942a-3e57-4c5c-b16e-c0776c68047f admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:47.275498 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd942a-3e57-4c5c-b16e-c0776c68047f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:47.277127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd942a-3e57-4c5c-b16e-c0776c68047f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:47.287942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1339/2654] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:47.292013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f189a21-d186-46a2-9d9b-656c87a86637 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:47.302565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f189a21-d186-46a2-9d9b-656c87a86637 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:47.307326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054d961-88f5-43f9-b5fe-90388fb97f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:47.308021 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054d961-88f5-43f9-b5fe-90388fb97f66 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:47.308305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054d961-88f5-43f9-b5fe-90388fb97f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:47.308585 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054d961-88f5-43f9-b5fe-90388fb97f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:47.309304 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054d961-88f5-43f9-b5fe-90388fb97f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:47.310890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054d961-88f5-43f9-b5fe-90388fb97f66 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:47.320758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1316/2655] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:47.324778 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd942a-3e57-4c5c-b16e-c0776c68047f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:47.334643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd942a-3e57-4c5c-b16e-c0776c68047f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:47.339169 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321809-fc2a-41d2-8744-1b2c52412011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:47.340069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321809-fc2a-41d2-8744-1b2c52412011 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:47.340346 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321809-fc2a-41d2-8744-1b2c52412011 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:47.340622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321809-fc2a-41d2-8744-1b2c52412011 admin admin] PATH_INFO: `/v3/projects/b462444f339a4d99b70c8708b7edc053/users/531aedb39895457f83865b0eeae14ffc/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:47.356350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321809-fc2a-41d2-8744-1b2c52412011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b462444f339a4d99b70c8708b7edc053, user_id=531aedb39895457f83865b0eeae14ffc, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:47.358432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321809-fc2a-41d2-8744-1b2c52412011 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:47.438683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1340/2656] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:47 2022] PUT /identity/v3/projects/b462444f339a4d99b70c8708b7edc053/users/531aedb39895457f83865b0eeae14ffc/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:47.449736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbd57e-4f61-4e41-aafd-436dba260b67 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:47.450034 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbd57e-4f61-4e41-aafd-436dba260b67 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:47.450318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbd57e-4f61-4e41-aafd-436dba260b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:47.477675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-c3bbd57e-4f61-4e41-aafd-436dba260b67 None None] MFA Rules not processed for user `531aedb39895457f83865b0eeae14ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:47.478884 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c3bbd57e-4f61-4e41-aafd-436dba260b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:47.542560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1317/2657] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:47.547063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321809-fc2a-41d2-8744-1b2c52412011 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:47.607713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321809-fc2a-41d2-8744-1b2c52412011 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:47.612403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6590a-fb9b-4523-848b-d012df561d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:47.616698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6590a-fb9b-4523-848b-d012df561d18 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:47.616698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6590a-fb9b-4523-848b-d012df561d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:47.616698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6590a-fb9b-4523-848b-d012df561d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:47.616698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6590a-fb9b-4523-848b-d012df561d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:47.616698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6590a-fb9b-4523-848b-d012df561d18 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:47.840518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1341/2658] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:47 2022] POST /identity/v3/projects => generated 401 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:47.844628 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbd57e-4f61-4e41-aafd-436dba260b67 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:47.855936 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbd57e-4f61-4e41-aafd-436dba260b67 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:47.914918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0a59a-bf62-4814-8b59-8e78542dbb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:47.915588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0a59a-bf62-4814-8b59-8e78542dbb32 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:47.915918 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0a59a-bf62-4814-8b59-8e78542dbb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:47.916221 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0a59a-bf62-4814-8b59-8e78542dbb32 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:47.916975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0a59a-bf62-4814-8b59-8e78542dbb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:47.918876 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0a59a-bf62-4814-8b59-8e78542dbb32 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:48.014300 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:48.020181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1318/2659] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:47 2022] POST /identity/v3/users => generated 307 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:48.024087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6590a-fb9b-4523-848b-d012df561d18 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:48.036623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6590a-fb9b-4523-848b-d012df561d18 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:48.041656 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab1654-24cf-4f0b-b076-55ae9351f68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:48.042326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab1654-24cf-4f0b-b076-55ae9351f68d admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:48.042611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab1654-24cf-4f0b-b076-55ae9351f68d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:48.043392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab1654-24cf-4f0b-b076-55ae9351f68d admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:48.043620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab1654-24cf-4f0b-b076-55ae9351f68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:48.046035 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab1654-24cf-4f0b-b076-55ae9351f68d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:48.057386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1342/2660] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:48.061565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0a59a-bf62-4814-8b59-8e78542dbb32 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:48.071487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0a59a-bf62-4814-8b59-8e78542dbb32 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:48.076842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e7b3e-ac0e-42d0-af5d-e5c753279fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:48.077796 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e7b3e-ac0e-42d0-af5d-e5c753279fce admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:48.087718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e7b3e-ac0e-42d0-af5d-e5c753279fce admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:48.087718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e7b3e-ac0e-42d0-af5d-e5c753279fce admin admin] PATH_INFO: `/v3/projects/bac2a8fae670451296f65a810c0f04bf/users/8375bb7a7d5942b6901f360aeaf9a088/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:48.093738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e7b3e-ac0e-42d0-af5d-e5c753279fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac2a8fae670451296f65a810c0f04bf, user_id=8375bb7a7d5942b6901f360aeaf9a088, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:48.096428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e7b3e-ac0e-42d0-af5d-e5c753279fce admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:48.198974 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1319/2661] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:48 2022] PUT /identity/v3/projects/bac2a8fae670451296f65a810c0f04bf/users/8375bb7a7d5942b6901f360aeaf9a088/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:48.208467 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab1654-24cf-4f0b-b076-55ae9351f68d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:48.218965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab1654-24cf-4f0b-b076-55ae9351f68d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:48.277143 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf5121-5f81-4709-94b8-05313c577601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:48.277804 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf5121-5f81-4709-94b8-05313c577601 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:48.278109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf5121-5f81-4709-94b8-05313c577601 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:48.278922 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf5121-5f81-4709-94b8-05313c577601 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:48.279633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf5121-5f81-4709-94b8-05313c577601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:48.281295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf5121-5f81-4709-94b8-05313c577601 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:48.291453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1343/2662] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:48.295278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e7b3e-ac0e-42d0-af5d-e5c753279fce admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:48.305718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e7b3e-ac0e-42d0-af5d-e5c753279fce admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:48.310323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2ae8d-c821-44ee-9687-43bd29349254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:48.311192 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2ae8d-c821-44ee-9687-43bd29349254 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:48.311472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2ae8d-c821-44ee-9687-43bd29349254 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:48.311802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2ae8d-c821-44ee-9687-43bd29349254 admin admin] PATH_INFO: `/v3/projects/bac2a8fae670451296f65a810c0f04bf/users/8375bb7a7d5942b6901f360aeaf9a088/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:48.317329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2ae8d-c821-44ee-9687-43bd29349254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac2a8fae670451296f65a810c0f04bf, user_id=8375bb7a7d5942b6901f360aeaf9a088, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:48.317329 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2ae8d-c821-44ee-9687-43bd29349254 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:48.327201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1320/2663] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:48 2022] PUT /identity/v3/projects/bac2a8fae670451296f65a810c0f04bf/users/8375bb7a7d5942b6901f360aeaf9a088/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:48.337263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521c01e-f0b5-4158-ae94-5ba667833bb0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:48.337647 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521c01e-f0b5-4158-ae94-5ba667833bb0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:48.337996 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521c01e-f0b5-4158-ae94-5ba667833bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:48.365503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-8521c01e-f0b5-4158-ae94-5ba667833bb0 None None] MFA Rules not processed for user `8375bb7a7d5942b6901f360aeaf9a088`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:48.366708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8521c01e-f0b5-4158-ae94-5ba667833bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:48.395141 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:48.432820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1344/2664] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:48.443341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2ae8d-c821-44ee-9687-43bd29349254 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:48.445068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-afd2ae8d-c821-44ee-9687-43bd29349254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:48.500239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2ae8d-c821-44ee-9687-43bd29349254 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:48.503859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe283c-fdfc-4dbc-a535-772f44051447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:48.504657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe283c-fdfc-4dbc-a535-772f44051447 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:48.504942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe283c-fdfc-4dbc-a535-772f44051447 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:48.505219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe283c-fdfc-4dbc-a535-772f44051447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:48.514963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe283c-fdfc-4dbc-a535-772f44051447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:48.516429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe283c-fdfc-4dbc-a535-772f44051447 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:48.525710 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1321/2665] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:48.754681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521c01e-f0b5-4158-ae94-5ba667833bb0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:48.765116 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521c01e-f0b5-4158-ae94-5ba667833bb0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:48.768829 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfad60a-fc83-4d1b-821d-078573d204e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:48.769471 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad60a-fc83-4d1b-821d-078573d204e2 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:48.769754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad60a-fc83-4d1b-821d-078573d204e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:48.770030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad60a-fc83-4d1b-821d-078573d204e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:48.836154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfad60a-fc83-4d1b-821d-078573d204e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:48.837651 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfad60a-fc83-4d1b-821d-078573d204e2 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:48.846708 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1345/2666] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:53.886385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe283c-fdfc-4dbc-a535-772f44051447 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:53.948653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe283c-fdfc-4dbc-a535-772f44051447 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:53.953690 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:53.954550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:53.954831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:53.955109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] PATH_INFO: `/v3/users/531aedb39895457f83865b0eeae14ffc` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:53.956311 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531aedb39895457f83865b0eeae14ffc)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:53.958230 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:54.165562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531aedb39895457f83865b0eeae14ffc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:54.167097 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531aedb39895457f83865b0eeae14ffc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:54.243943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531aedb39895457f83865b0eeae14ffc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:54.251807 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531aedb39895457f83865b0eeae14ffc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:54.256412 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:54.264755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531aedb39895457f83865b0eeae14ffc'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:54.270733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1322/2667] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:53 2022] DELETE /identity/v3/users/531aedb39895457f83865b0eeae14ffc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:54.275239 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486f154-5673-464a-9018-641288486158 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:54.276715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486f154-5673-464a-9018-641288486158 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:54.276715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486f154-5673-464a-9018-641288486158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:54.292445 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-a486f154-5673-464a-9018-641288486158 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:54.293645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a486f154-5673-464a-9018-641288486158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:54.352305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1346/2668] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:54.361790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:54.363403 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:54.429460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee21de6-5cf1-4dc7-8aff-e317b77347b3 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:54.433621 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393432-4ddc-451f-ab22-2671c7d327ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:54.434379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393432-4ddc-451f-ab22-2671c7d327ae service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:54.434671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393432-4ddc-451f-ab22-2671c7d327ae service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:54.434935 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393432-4ddc-451f-ab22-2671c7d327ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:54.445590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38393432-4ddc-451f-ab22-2671c7d327ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:54.447185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38393432-4ddc-451f-ab22-2671c7d327ae service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:54.457950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1323/2669] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:54.979865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486f154-5673-464a-9018-641288486158 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:54.981285 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-a486f154-5673-464a-9018-641288486158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:54.993816 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486f154-5673-464a-9018-641288486158 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:54.999127 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:55.000011 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:55.000294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:55.000569 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] PATH_INFO: `/v3/projects/b462444f339a4d99b70c8708b7edc053` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:55.001750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b462444f339a4d99b70c8708b7edc053)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:55.003711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:55.124935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b462444f339a4d99b70c8708b7edc053', 'request_id': 'req-512971dd-df75-4c06-9c99-194924e26603'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.130597 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b462444f339a4d99b70c8708b7edc053', 'request_id': 'req-512971dd-df75-4c06-9c99-194924e26603'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.131754 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:55.137446 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b462444f339a4d99b70c8708b7edc053', 'request_id': 'req-512971dd-df75-4c06-9c99-194924e26603'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.197869 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] The token cache is being invalidate because project b462444f339a4d99b70c8708b7edc053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:55.198155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.198797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.200609 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1347/2670] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:54 2022] DELETE /identity/v3/projects/b462444f339a4d99b70c8708b7edc053 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:55.204472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393432-4ddc-451f-ab22-2671c7d327ae service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:55.213914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393432-4ddc-451f-ab22-2671c7d327ae service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:55.267783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:55.268568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:55.268850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:55.269157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] PATH_INFO: `/v3/users/8375bb7a7d5942b6901f360aeaf9a088` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:55.270342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8375bb7a7d5942b6901f360aeaf9a088)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:55.272364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:55.422601 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8375bb7a7d5942b6901f360aeaf9a088'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.423257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8375bb7a7d5942b6901f360aeaf9a088'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.480659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8375bb7a7d5942b6901f360aeaf9a088'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.487679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8375bb7a7d5942b6901f360aeaf9a088'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.499287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-08470e43-b29e-43f7-ade4-aab043963d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8375bb7a7d5942b6901f360aeaf9a088'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:55.505070 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1324/2671] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:55 2022] DELETE /identity/v3/users/8375bb7a7d5942b6901f360aeaf9a088 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:55.965385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:55.967955 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:55.981848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512971dd-df75-4c06-9c99-194924e26603 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:56.041407 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:56.042188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.042493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.042733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] PATH_INFO: `/v3/projects/bac2a8fae670451296f65a810c0f04bf` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:56.044052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac2a8fae670451296f65a810c0f04bf)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:56.045994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:56.184535 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac2a8fae670451296f65a810c0f04bf', 'request_id': 'req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:56.190503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac2a8fae670451296f65a810c0f04bf', 'request_id': 'req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:56.196523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac2a8fae670451296f65a810c0f04bf', 'request_id': 'req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:56.292014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] The token cache is being invalidate because project bac2a8fae670451296f65a810c0f04bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:56.292132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:56.292716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-afa74dc1-70a1-459d-a2ff-5aabfdcb3a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:56.295085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1348/2672] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:55 2022] DELETE /identity/v3/projects/bac2a8fae670451296f65a810c0f04bf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:56.299854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213f69-a194-41a7-a198-7b5a98ae043f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.300341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213f69-a194-41a7-a198-7b5a98ae043f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.300586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213f69-a194-41a7-a198-7b5a98ae043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:56.313850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:56.320338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-42213f69-a194-41a7-a198-7b5a98ae043f None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:56.321569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-42213f69-a194-41a7-a198-7b5a98ae043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:56.380868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1325/2673] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:56.389008 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79de840-2f7e-418a-83f5-c08e92ca49b1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.389332 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79de840-2f7e-418a-83f5-c08e92ca49b1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.389625 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79de840-2f7e-418a-83f5-c08e92ca49b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:56.408081 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-b79de840-2f7e-418a-83f5-c08e92ca49b1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:56.409305 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b79de840-2f7e-418a-83f5-c08e92ca49b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:56.417751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1349/2674] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:56.422704 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213f69-a194-41a7-a198-7b5a98ae043f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:56.434415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213f69-a194-41a7-a198-7b5a98ae043f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:56.439901 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655761d0-b3cf-4dee-969c-a807db40a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:56.440725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655761d0-b3cf-4dee-969c-a807db40a0ab admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.441198 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655761d0-b3cf-4dee-969c-a807db40a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.441470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655761d0-b3cf-4dee-969c-a807db40a0ab admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:56.442182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655761d0-b3cf-4dee-969c-a807db40a0ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:46:56.442486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655761d0-b3cf-4dee-969c-a807db40a0ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:56.444238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655761d0-b3cf-4dee-969c-a807db40a0ab admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:56.456024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1326/2675] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:46:56.461732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79de840-2f7e-418a-83f5-c08e92ca49b1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:56.470936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79de840-2f7e-418a-83f5-c08e92ca49b1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:56.476099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9eca1-9c51-453b-b0ed-367962e6f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:56.476798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9eca1-9c51-453b-b0ed-367962e6f86a admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.477142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9eca1-9c51-453b-b0ed-367962e6f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.477416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9eca1-9c51-453b-b0ed-367962e6f86a admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:56.478142 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9eca1-9c51-453b-b0ed-367962e6f86a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:56.480256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9eca1-9c51-453b-b0ed-367962e6f86a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:56.574371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1350/2676] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:56 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:56.578552 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655761d0-b3cf-4dee-969c-a807db40a0ab admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:56.588606 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655761d0-b3cf-4dee-969c-a807db40a0ab admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:56.643757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58b295-4e1c-4342-af37-f947069f9c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:56.644940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b295-4e1c-4342-af37-f947069f9c9e admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.644940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b295-4e1c-4342-af37-f947069f9c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.644940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b295-4e1c-4342-af37-f947069f9c9e admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:56.645623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b295-4e1c-4342-af37-f947069f9c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:56.647536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b295-4e1c-4342-af37-f947069f9c9e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:56.807286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1327/2677] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:56 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:56.811242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9eca1-9c51-453b-b0ed-367962e6f86a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:56.821422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9eca1-9c51-453b-b0ed-367962e6f86a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:56.831762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5cc7c-b0da-41fb-a089-f5bfcd5ac68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:56.831762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5cc7c-b0da-41fb-a089-f5bfcd5ac68b admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.831762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5cc7c-b0da-41fb-a089-f5bfcd5ac68b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.831762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5cc7c-b0da-41fb-a089-f5bfcd5ac68b admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:56.832151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5cc7c-b0da-41fb-a089-f5bfcd5ac68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:56.832151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5cc7c-b0da-41fb-a089-f5bfcd5ac68b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:56.843532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1351/2678] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:56.844856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58b295-4e1c-4342-af37-f947069f9c9e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:56.855410 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58b295-4e1c-4342-af37-f947069f9c9e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:56.860887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c13bd7-ba0c-414e-b836-6a497b2d205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:56.861544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13bd7-ba0c-414e-b836-6a497b2d205d admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.861829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13bd7-ba0c-414e-b836-6a497b2d205d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.862108 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13bd7-ba0c-414e-b836-6a497b2d205d admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:56.862827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c13bd7-ba0c-414e-b836-6a497b2d205d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:56.864482 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c13bd7-ba0c-414e-b836-6a497b2d205d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:56.879506 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1328/2679] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:56.880725 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5cc7c-b0da-41fb-a089-f5bfcd5ac68b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:56.894986 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5cc7c-b0da-41fb-a089-f5bfcd5ac68b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:56.900424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f778f27-851a-4792-b057-25777d64c5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:56.901452 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f778f27-851a-4792-b057-25777d64c5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.901867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f778f27-851a-4792-b057-25777d64c5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.902201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f778f27-851a-4792-b057-25777d64c5bd admin admin] PATH_INFO: `/v3/projects/92af9b7a328e43d9bc2dc287a1279fcd/users/ade356497026407fa1a2f7246938a059/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:56.920000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f778f27-851a-4792-b057-25777d64c5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=92af9b7a328e43d9bc2dc287a1279fcd, user_id=ade356497026407fa1a2f7246938a059, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:56.922681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f778f27-851a-4792-b057-25777d64c5bd admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:56.987574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1352/2680] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:56 2022] PUT /identity/v3/projects/92af9b7a328e43d9bc2dc287a1279fcd/users/ade356497026407fa1a2f7246938a059/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:56.991272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca583619-fad7-4ef4-a2a9-31c9c099b290 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:56.991805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca583619-fad7-4ef4-a2a9-31c9c099b290 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:56.992677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca583619-fad7-4ef4-a2a9-31c9c099b290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:57.028470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ca583619-fad7-4ef4-a2a9-31c9c099b290 None None] MFA Rules not processed for user `ade356497026407fa1a2f7246938a059`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:57.030196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ca583619-fad7-4ef4-a2a9-31c9c099b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:57.100109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1329/2681] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:57.104487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f778f27-851a-4792-b057-25777d64c5bd admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:57.117875 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:57.165988 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f778f27-851a-4792-b057-25777d64c5bd admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:57.170676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128fed7-881f-41c7-b3ef-d3b2a00ca369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:57.171328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128fed7-881f-41c7-b3ef-d3b2a00ca369 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:57.171613 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128fed7-881f-41c7-b3ef-d3b2a00ca369 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:57.171926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128fed7-881f-41c7-b3ef-d3b2a00ca369 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:57.172738 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128fed7-881f-41c7-b3ef-d3b2a00ca369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:57.174692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128fed7-881f-41c7-b3ef-d3b2a00ca369 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:57.256772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1353/2682] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:46:57 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:57.260848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca583619-fad7-4ef4-a2a9-31c9c099b290 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:57.267509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:57.273099 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca583619-fad7-4ef4-a2a9-31c9c099b290 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:57.328129 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a5581-b559-4224-9fe8-ac28749ba518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:57.328785 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a5581-b559-4224-9fe8-ac28749ba518 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:57.329066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a5581-b559-4224-9fe8-ac28749ba518 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:57.329338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a5581-b559-4224-9fe8-ac28749ba518 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:57.330012 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a5581-b559-4224-9fe8-ac28749ba518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:57.331939 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a5581-b559-4224-9fe8-ac28749ba518 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:57.433116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1330/2683] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:46:57 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:46:57.437743 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128fed7-881f-41c7-b3ef-d3b2a00ca369 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:57.448122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128fed7-881f-41c7-b3ef-d3b2a00ca369 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:57.453394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1512ae7-92d9-4150-8607-037bb609d101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:57.454052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512ae7-92d9-4150-8607-037bb609d101 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:57.454334 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512ae7-92d9-4150-8607-037bb609d101 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:57.459095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512ae7-92d9-4150-8607-037bb609d101 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:57.459095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1512ae7-92d9-4150-8607-037bb609d101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:57.459095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1512ae7-92d9-4150-8607-037bb609d101 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:57.467567 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1354/2684] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:57.471626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a5581-b559-4224-9fe8-ac28749ba518 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:57.481478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a5581-b559-4224-9fe8-ac28749ba518 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:57.486084 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0effdb-36a3-40b0-93d1-9edcb7eed272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:57.488008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0effdb-36a3-40b0-93d1-9edcb7eed272 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:57.488008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0effdb-36a3-40b0-93d1-9edcb7eed272 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:57.488008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0effdb-36a3-40b0-93d1-9edcb7eed272 admin admin] PATH_INFO: `/v3/projects/62d15d16f5c84866ad9188d22a412cf1/users/da5a219890f84b02b90bf959b4225278/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:57.502301 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0effdb-36a3-40b0-93d1-9edcb7eed272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d15d16f5c84866ad9188d22a412cf1, user_id=da5a219890f84b02b90bf959b4225278, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:57.504971 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0effdb-36a3-40b0-93d1-9edcb7eed272 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:57.569924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1331/2685] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:57 2022] PUT /identity/v3/projects/62d15d16f5c84866ad9188d22a412cf1/users/da5a219890f84b02b90bf959b4225278/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:57.573953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1512ae7-92d9-4150-8607-037bb609d101 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:57.584632 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1512ae7-92d9-4150-8607-037bb609d101 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:57.642462 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015a70-cb24-4deb-ac9c-46903ef4e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:57.643151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015a70-cb24-4deb-ac9c-46903ef4e327 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:57.643463 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015a70-cb24-4deb-ac9c-46903ef4e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:57.643762 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015a70-cb24-4deb-ac9c-46903ef4e327 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:57.644500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c015a70-cb24-4deb-ac9c-46903ef4e327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:57.646109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c015a70-cb24-4deb-ac9c-46903ef4e327 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:57.656064 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1355/2686] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:46:57.660125 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0effdb-36a3-40b0-93d1-9edcb7eed272 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:57.670931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0effdb-36a3-40b0-93d1-9edcb7eed272 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:57.675660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7e923-012d-44a0-9a6a-493cbc6e9cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:57.676587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7e923-012d-44a0-9a6a-493cbc6e9cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:57.676858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7e923-012d-44a0-9a6a-493cbc6e9cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:57.677145 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7e923-012d-44a0-9a6a-493cbc6e9cfb admin admin] PATH_INFO: `/v3/projects/62d15d16f5c84866ad9188d22a412cf1/users/da5a219890f84b02b90bf959b4225278/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:57.679225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7e923-012d-44a0-9a6a-493cbc6e9cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d15d16f5c84866ad9188d22a412cf1, user_id=da5a219890f84b02b90bf959b4225278, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:57.681899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7e923-012d-44a0-9a6a-493cbc6e9cfb admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:57.692836 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1332/2687] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:46:57 2022] PUT /identity/v3/projects/62d15d16f5c84866ad9188d22a412cf1/users/da5a219890f84b02b90bf959b4225278/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:57.702882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ad278-0687-43ca-8772-d03771d0f24d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:57.703173 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ad278-0687-43ca-8772-d03771d0f24d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:57.703450 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ad278-0687-43ca-8772-d03771d0f24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:57.729884 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d38ad278-0687-43ca-8772-d03771d0f24d None None] MFA Rules not processed for user `da5a219890f84b02b90bf959b4225278`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:57.731128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d38ad278-0687-43ca-8772-d03771d0f24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:57.800769 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1356/2688] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:57.813269 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7e923-012d-44a0-9a6a-493cbc6e9cfb admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:57.815085 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-24a7e923-012d-44a0-9a6a-493cbc6e9cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:57.872057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7e923-012d-44a0-9a6a-493cbc6e9cfb admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:57.876404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0604b-e040-4d71-bef6-787cd5879f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:57.877048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0604b-e040-4d71-bef6-787cd5879f4a service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:57.877334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0604b-e040-4d71-bef6-787cd5879f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:57.877613 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0604b-e040-4d71-bef6-787cd5879f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:57.886832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0604b-e040-4d71-bef6-787cd5879f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:57.889643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0604b-e040-4d71-bef6-787cd5879f4a service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:57.898682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1333/2689] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:58.040726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ad278-0687-43ca-8772-d03771d0f24d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:58.051331 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ad278-0687-43ca-8772-d03771d0f24d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:58.056380 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da972-31e6-4b8d-9c4f-8d6c52a3c2b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:58.058085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da972-31e6-4b8d-9c4f-8d6c52a3c2b7 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:58.058085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da972-31e6-4b8d-9c4f-8d6c52a3c2b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:58.058085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da972-31e6-4b8d-9c4f-8d6c52a3c2b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:58.063031 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:58.121537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da972-31e6-4b8d-9c4f-8d6c52a3c2b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:58.123172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da972-31e6-4b8d-9c4f-8d6c52a3c2b7 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:58.135420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1357/2690] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:58.681965 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0604b-e040-4d71-bef6-787cd5879f4a service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:58.742287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:58.746444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0604b-e040-4d71-bef6-787cd5879f4a service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:58.751797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:58.755797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:58.755797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:58.755797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] PATH_INFO: `/v3/users/ade356497026407fa1a2f7246938a059` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:58.755797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade356497026407fa1a2f7246938a059)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:58.756405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:58.954568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade356497026407fa1a2f7246938a059'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:58.955219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade356497026407fa1a2f7246938a059'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:59.038054 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade356497026407fa1a2f7246938a059'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:59.046210 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade356497026407fa1a2f7246938a059'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:59.058669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade356497026407fa1a2f7246938a059'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:59.064656 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1334/2691] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:58 2022] DELETE /identity/v3/users/ade356497026407fa1a2f7246938a059 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:59.069183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f422fe-9fd0-47bc-b2bd-6972dc6f393b None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:59.069636 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f422fe-9fd0-47bc-b2bd-6972dc6f393b None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:59.069779 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f422fe-9fd0-47bc-b2bd-6972dc6f393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:59.086681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d9f422fe-9fd0-47bc-b2bd-6972dc6f393b None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:46:59.087982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d9f422fe-9fd0-47bc-b2bd-6972dc6f393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:59.147060 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1358/2692] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:46:59.157325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:59.158736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:59.216370 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22143b-60d3-48c6-b36b-ec283618bfc1 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:59.220722 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc52cd8-664b-4a45-91b8-687018dee1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:59.221368 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc52cd8-664b-4a45-91b8-687018dee1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:59.221693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc52cd8-664b-4a45-91b8-687018dee1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:59.221922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc52cd8-664b-4a45-91b8-687018dee1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:59.232373 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc52cd8-664b-4a45-91b8-687018dee1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:59.233818 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc52cd8-664b-4a45-91b8-687018dee1b0 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:59.243637 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1335/2693] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:59.642703 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f422fe-9fd0-47bc-b2bd-6972dc6f393b None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:59.644313 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d9f422fe-9fd0-47bc-b2bd-6972dc6f393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:59.658379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f422fe-9fd0-47bc-b2bd-6972dc6f393b None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:59.663345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:59.664267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:59.664556 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:59.664866 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] PATH_INFO: `/v3/projects/92af9b7a328e43d9bc2dc287a1279fcd` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:59.666136 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=92af9b7a328e43d9bc2dc287a1279fcd)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:59.668181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:59.767077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92af9b7a328e43d9bc2dc287a1279fcd', 'request_id': 'req-189efbac-cf2b-45cc-acbf-3d79a75b5daa'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:59.772470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92af9b7a328e43d9bc2dc287a1279fcd', 'request_id': 'req-189efbac-cf2b-45cc-acbf-3d79a75b5daa'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:59.778493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92af9b7a328e43d9bc2dc287a1279fcd', 'request_id': 'req-189efbac-cf2b-45cc-acbf-3d79a75b5daa'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:59.854626 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] The token cache is being invalidate because project 92af9b7a328e43d9bc2dc287a1279fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:46:59.854942 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:59.855594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:46:59.857707 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1359/2694] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:46:59 2022] DELETE /identity/v3/projects/92af9b7a328e43d9bc2dc287a1279fcd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:46:59.861619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc52cd8-664b-4a45-91b8-687018dee1b0 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:59.871344 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc52cd8-664b-4a45-91b8-687018dee1b0 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:59.929594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:59.930460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:59.930745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:59.931024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] PATH_INFO: `/v3/users/da5a219890f84b02b90bf959b4225278` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:59.932249 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da5a219890f84b02b90bf959b4225278)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:59.934160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:59.956318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:00.144831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da5a219890f84b02b90bf959b4225278'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:00.145490 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da5a219890f84b02b90bf959b4225278'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:00.218073 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da5a219890f84b02b90bf959b4225278'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:00.226864 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da5a219890f84b02b90bf959b4225278'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:00.239899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-97d10334-c5d7-4190-95a8-57eca7d55082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da5a219890f84b02b90bf959b4225278'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:00.246268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1336/2695] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:46:59 2022] DELETE /identity/v3/users/da5a219890f84b02b90bf959b4225278 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:00.802652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:00.804420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:00.832012 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189efbac-cf2b-45cc-acbf-3d79a75b5daa admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:00.868709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:00.898545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:00.899420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:00.899706 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:00.900054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] PATH_INFO: `/v3/projects/62d15d16f5c84866ad9188d22a412cf1` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:00.901247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d15d16f5c84866ad9188d22a412cf1)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:00.904402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:01.007653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d15d16f5c84866ad9188d22a412cf1', 'request_id': 'req-3196521a-a015-4578-9635-929a6360e1db'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:01.015588 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d15d16f5c84866ad9188d22a412cf1', 'request_id': 'req-3196521a-a015-4578-9635-929a6360e1db'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:01.022732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d15d16f5c84866ad9188d22a412cf1', 'request_id': 'req-3196521a-a015-4578-9635-929a6360e1db'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:01.086135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] The token cache is being invalidate because project 62d15d16f5c84866ad9188d22a412cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:47:01.086428 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:01.087683 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-3196521a-a015-4578-9635-929a6360e1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:01.089526 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1360/2696] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:47:00 2022] DELETE /identity/v3/projects/62d15d16f5c84866ad9188d22a412cf1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:01.094430 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87945bb6-6a12-4091-a63e-38158b1ff1f1 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.094954 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87945bb6-6a12-4091-a63e-38158b1ff1f1 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.095055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87945bb6-6a12-4091-a63e-38158b1ff1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.114047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-87945bb6-6a12-4091-a63e-38158b1ff1f1 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:01.115362 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-87945bb6-6a12-4091-a63e-38158b1ff1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:01.181736 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1337/2697] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:01.196024 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc831c-6881-425e-bf0a-5af62cf78c72 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.196320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc831c-6881-425e-bf0a-5af62cf78c72 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.196608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc831c-6881-425e-bf0a-5af62cf78c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.215532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-aefc831c-6881-425e-bf0a-5af62cf78c72 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:01.216834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-aefc831c-6881-425e-bf0a-5af62cf78c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:01.224726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1361/2698] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:01.228919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87945bb6-6a12-4091-a63e-38158b1ff1f1 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:01.238587 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87945bb6-6a12-4091-a63e-38158b1ff1f1 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:01.248350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737433-59db-4b81-ae82-796df028c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:01.249009 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737433-59db-4b81-ae82-796df028c1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.249298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737433-59db-4b81-ae82-796df028c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.249582 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737433-59db-4b81-ae82-796df028c1c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.250306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737433-59db-4b81-ae82-796df028c1c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:47:01.250619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737433-59db-4b81-ae82-796df028c1c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:01.252235 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737433-59db-4b81-ae82-796df028c1c8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:01.267181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1338/2699] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:47:01.271665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc831c-6881-425e-bf0a-5af62cf78c72 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:01.281216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc831c-6881-425e-bf0a-5af62cf78c72 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:01.285879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289f465-ed26-4ab4-bad9-3524035425df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:01.286525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289f465-ed26-4ab4-bad9-3524035425df admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.286814 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289f465-ed26-4ab4-bad9-3524035425df admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.287096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289f465-ed26-4ab4-bad9-3524035425df admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.287825 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289f465-ed26-4ab4-bad9-3524035425df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:01.289751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289f465-ed26-4ab4-bad9-3524035425df admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:01.361913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1362/2700] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:47:01 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:47:01.366067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737433-59db-4b81-ae82-796df028c1c8 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:01.376715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737433-59db-4b81-ae82-796df028c1c8 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:01.432932 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee64e44-21b2-4a50-818f-0936edbabeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:01.433680 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee64e44-21b2-4a50-818f-0936edbabeed admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.433973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee64e44-21b2-4a50-818f-0936edbabeed admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.434258 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee64e44-21b2-4a50-818f-0936edbabeed admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.434946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee64e44-21b2-4a50-818f-0936edbabeed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:01.437444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee64e44-21b2-4a50-818f-0936edbabeed admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:01.557056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1339/2701] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:47:01 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:47:01.557179 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289f465-ed26-4ab4-bad9-3524035425df admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:01.567865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289f465-ed26-4ab4-bad9-3524035425df admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:01.572643 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402189-9330-456a-b36c-4f7adbdfd57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:01.573302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402189-9330-456a-b36c-4f7adbdfd57b admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.573620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402189-9330-456a-b36c-4f7adbdfd57b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.573900 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402189-9330-456a-b36c-4f7adbdfd57b admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.574612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402189-9330-456a-b36c-4f7adbdfd57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:01.576247 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402189-9330-456a-b36c-4f7adbdfd57b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:01.586861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1363/2702] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:01.591068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee64e44-21b2-4a50-818f-0936edbabeed admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:01.601620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee64e44-21b2-4a50-818f-0936edbabeed admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:01.606619 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac680d-52d6-4362-8355-d1db26b2900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:01.608336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac680d-52d6-4362-8355-d1db26b2900b admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.608336 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac680d-52d6-4362-8355-d1db26b2900b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.608547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac680d-52d6-4362-8355-d1db26b2900b admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.609219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac680d-52d6-4362-8355-d1db26b2900b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:01.610821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac680d-52d6-4362-8355-d1db26b2900b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:01.627263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1340/2703] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:01.631277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402189-9330-456a-b36c-4f7adbdfd57b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:01.651529 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402189-9330-456a-b36c-4f7adbdfd57b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:01.656827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25311b46-fb3d-4173-b27f-120238c7f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:01.657717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25311b46-fb3d-4173-b27f-120238c7f6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.658015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25311b46-fb3d-4173-b27f-120238c7f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.658277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25311b46-fb3d-4173-b27f-120238c7f6d8 admin admin] PATH_INFO: `/v3/projects/05044fc32cd8471185928547bdbbe3e0/users/cf1fabbf38db4a94ba3292fea72c7377/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.677080 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25311b46-fb3d-4173-b27f-120238c7f6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05044fc32cd8471185928547bdbbe3e0, user_id=cf1fabbf38db4a94ba3292fea72c7377, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:01.679865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25311b46-fb3d-4173-b27f-120238c7f6d8 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:01.787371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1364/2704] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:47:01 2022] PUT /identity/v3/projects/05044fc32cd8471185928547bdbbe3e0/users/cf1fabbf38db4a94ba3292fea72c7377/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:01.798719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e04e4-5ae2-4c6c-93d4-493d4da3c3a7 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.799001 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e04e4-5ae2-4c6c-93d4-493d4da3c3a7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.799341 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e04e4-5ae2-4c6c-93d4-493d4da3c3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.806428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:01.826207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-171e04e4-5ae2-4c6c-93d4-493d4da3c3a7 None None] MFA Rules not processed for user `cf1fabbf38db4a94ba3292fea72c7377`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:01.827419 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-171e04e4-5ae2-4c6c-93d4-493d4da3c3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:01.891997 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1341/2705] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:01.903289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25311b46-fb3d-4173-b27f-120238c7f6d8 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:01.905679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-25311b46-fb3d-4173-b27f-120238c7f6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:01.962795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25311b46-fb3d-4173-b27f-120238c7f6d8 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:01.967115 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb824f96-b844-4df4-95de-c0b55f00343c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:01.967751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb824f96-b844-4df4-95de-c0b55f00343c service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:01.968047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb824f96-b844-4df4-95de-c0b55f00343c service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:01.968336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb824f96-b844-4df4-95de-c0b55f00343c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:01.977731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb824f96-b844-4df4-95de-c0b55f00343c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:01.979250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb824f96-b844-4df4-95de-c0b55f00343c service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:01.984560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:01.989294 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1365/2706] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:02.008822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e04e4-5ae2-4c6c-93d4-493d4da3c3a7 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:02.076668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e04e4-5ae2-4c6c-93d4-493d4da3c3a7 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:02.081296 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:02.086350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:02.086350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:02.086350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] PATH_INFO: `/v3/users/cf1fabbf38db4a94ba3292fea72c7377` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:02.086350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1fabbf38db4a94ba3292fea72c7377)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:02.086350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:02.229293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1fabbf38db4a94ba3292fea72c7377'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:02.229961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1fabbf38db4a94ba3292fea72c7377'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:02.277914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1fabbf38db4a94ba3292fea72c7377'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:02.285534 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1fabbf38db4a94ba3292fea72c7377'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:02.297386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1fabbf38db4a94ba3292fea72c7377'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:02.303590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1342/2707] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:47:02 2022] DELETE /identity/v3/users/cf1fabbf38db4a94ba3292fea72c7377 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:02.308468 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d188a1b-e8cb-4069-8c00-46d34ada6fec None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:02.308760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d188a1b-e8cb-4069-8c00-46d34ada6fec None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:02.312773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d188a1b-e8cb-4069-8c00-46d34ada6fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:02.328358 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-8d188a1b-e8cb-4069-8c00-46d34ada6fec None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:02.329489 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8d188a1b-e8cb-4069-8c00-46d34ada6fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:02.392345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1366/2708] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:02.402081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:02.403487 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:02.418287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:02.457833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aead7f4-99c1-4348-a612-4a9983b33532 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:02.458130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aead7f4-99c1-4348-a612-4a9983b33532 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:02.458408 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aead7f4-99c1-4348-a612-4a9983b33532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:02.461734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1de90-c2c0-46d4-8c37-2050d357f839 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:02.466082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b5325-4633-41b2-8724-cfd637bc8054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:02.467265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b5325-4633-41b2-8724-cfd637bc8054 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:02.467752 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b5325-4633-41b2-8724-cfd637bc8054 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:02.467859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b5325-4633-41b2-8724-cfd637bc8054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:02.476982 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-2aead7f4-99c1-4348-a612-4a9983b33532 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:02.477133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b5325-4633-41b2-8724-cfd637bc8054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:02.478185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2aead7f4-99c1-4348-a612-4a9983b33532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:02.478483 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b5325-4633-41b2-8724-cfd637bc8054 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:02.488804 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1343/2709] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:02.534494 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1367/2710] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:47:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:47:02.667924 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b5325-4633-41b2-8724-cfd637bc8054 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:02.669321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e41b5325-4633-41b2-8724-cfd637bc8054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:02.749155 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b5325-4633-41b2-8724-cfd637bc8054 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:02.754829 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5771ef-f7bc-4b1c-9449-a20ece4f35f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:02.755664 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5771ef-f7bc-4b1c-9449-a20ece4f35f6 service swift] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:02.756071 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5771ef-f7bc-4b1c-9449-a20ece4f35f6 service swift] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:02.756470 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5771ef-f7bc-4b1c-9449-a20ece4f35f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:02.766493 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5771ef-f7bc-4b1c-9449-a20ece4f35f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:02.768121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5771ef-f7bc-4b1c-9449-a20ece4f35f6 service swift] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:02.776565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1344/2711] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:47:03.007771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aead7f4-99c1-4348-a612-4a9983b33532 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:03.009454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2aead7f4-99c1-4348-a612-4a9983b33532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:03.029107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aead7f4-99c1-4348-a612-4a9983b33532 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:03.034283 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:03.035297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.035681 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.036182 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] PATH_INFO: `/v3/projects/05044fc32cd8471185928547bdbbe3e0` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.037415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05044fc32cd8471185928547bdbbe3e0)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:03.039354 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:03.173298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05044fc32cd8471185928547bdbbe3e0', 'request_id': 'req-8702f06e-ac42-4cdc-a370-69fc9e1f9768'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:03.180302 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05044fc32cd8471185928547bdbbe3e0', 'request_id': 'req-8702f06e-ac42-4cdc-a370-69fc9e1f9768'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:03.188034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05044fc32cd8471185928547bdbbe3e0', 'request_id': 'req-8702f06e-ac42-4cdc-a370-69fc9e1f9768'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:03.274905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] The token cache is being invalidate because project 05044fc32cd8471185928547bdbbe3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:47:03.275203 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:03.275856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8702f06e-ac42-4cdc-a370-69fc9e1f9768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:03.277406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1368/2712] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:47:03 2022] DELETE /identity/v3/projects/05044fc32cd8471185928547bdbbe3e0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:03.282869 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49a2a3-7dae-45c6-ba44-6b751161b7be None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.283310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49a2a3-7dae-45c6-ba44-6b751161b7be None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.283544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49a2a3-7dae-45c6-ba44-6b751161b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.302196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ef49a2a3-7dae-45c6-ba44-6b751161b7be None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:03.303469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ef49a2a3-7dae-45c6-ba44-6b751161b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:03.380132 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1345/2713] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:47:03.384379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936755e9-1add-4278-9b3f-5a7e212368a0 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.384676 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936755e9-1add-4278-9b3f-5a7e212368a0 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.384988 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936755e9-1add-4278-9b3f-5a7e212368a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.404297 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-936755e9-1add-4278-9b3f-5a7e212368a0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:03.407659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-936755e9-1add-4278-9b3f-5a7e212368a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:03.413859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1369/2714] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:47:03.418529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49a2a3-7dae-45c6-ba44-6b751161b7be None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:03.429510 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49a2a3-7dae-45c6-ba44-6b751161b7be None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:03.438668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4e1ee-ae95-4a1f-9505-1f026c1aac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:03.438668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4e1ee-ae95-4a1f-9505-1f026c1aac3d admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.438668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4e1ee-ae95-4a1f-9505-1f026c1aac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.438668 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4e1ee-ae95-4a1f-9505-1f026c1aac3d admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.439026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4e1ee-ae95-4a1f-9505-1f026c1aac3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:47:03.439026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4e1ee-ae95-4a1f-9505-1f026c1aac3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:03.439026 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4e1ee-ae95-4a1f-9505-1f026c1aac3d admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:03.450945 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1346/2715] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:47:03.455281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936755e9-1add-4278-9b3f-5a7e212368a0 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:03.464545 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936755e9-1add-4278-9b3f-5a7e212368a0 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:03.469928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5992c-1cba-4001-ac6c-3d8045c1848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:03.470600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5992c-1cba-4001-ac6c-3d8045c1848b admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.470868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5992c-1cba-4001-ac6c-3d8045c1848b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.471149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5992c-1cba-4001-ac6c-3d8045c1848b admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.471896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5992c-1cba-4001-ac6c-3d8045c1848b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:03.473808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5992c-1cba-4001-ac6c-3d8045c1848b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:03.582926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:03.598566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1370/2716] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:47:03 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:47:03.599583 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4e1ee-ae95-4a1f-9505-1f026c1aac3d admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:03.610471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4e1ee-ae95-4a1f-9505-1f026c1aac3d admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:03.628663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4f23-6371-44f9-b981-b29390a91072 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.629090 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4f23-6371-44f9-b981-b29390a91072 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.629381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4f23-6371-44f9-b981-b29390a91072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.642190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=100 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:03.647826 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7a4e4f23-6371-44f9-b981-b29390a91072 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:03.649036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7a4e4f23-6371-44f9-b981-b29390a91072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:03.671172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7386e-78b8-47f3-891e-b36f7a39a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:03.671774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7386e-78b8-47f3-891e-b36f7a39a1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.672164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7386e-78b8-47f3-891e-b36f7a39a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.672438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7386e-78b8-47f3-891e-b36f7a39a1b7 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.673121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7386e-78b8-47f3-891e-b36f7a39a1b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:03.675079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7386e-78b8-47f3-891e-b36f7a39a1b7 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:03.704899 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1371/2717] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 16 00:47:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:47:03.720412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e4f23-6371-44f9-b981-b29390a91072 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:03.720412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7a4e4f23-6371-44f9-b981-b29390a91072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:03.787442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e4f23-6371-44f9-b981-b29390a91072 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:03.792471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1347/2718] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:47:03 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:47:03.793195 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f125fe8-3f35-489c-8d54-9d08da71af9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:03.794456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f125fe8-3f35-489c-8d54-9d08da71af9c service swift] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.794806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f125fe8-3f35-489c-8d54-9d08da71af9c service swift] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.795090 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f125fe8-3f35-489c-8d54-9d08da71af9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.797630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7386e-78b8-47f3-891e-b36f7a39a1b7 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:03.803970 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f125fe8-3f35-489c-8d54-9d08da71af9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:03.805669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f125fe8-3f35-489c-8d54-9d08da71af9c service swift] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:03.807307 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7386e-78b8-47f3-891e-b36f7a39a1b7 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:03.812157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed60b6-718e-43e9-b94f-3fdd7f120a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:03.812809 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed60b6-718e-43e9-b94f-3fdd7f120a0b admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.821517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed60b6-718e-43e9-b94f-3fdd7f120a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.821517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed60b6-718e-43e9-b94f-3fdd7f120a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.822412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1372/2719] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:47:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:47:03.822604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed60b6-718e-43e9-b94f-3fdd7f120a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:03.822604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed60b6-718e-43e9-b94f-3fdd7f120a0b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:03.827055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1348/2720] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:03.830752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f125fe8-3f35-489c-8d54-9d08da71af9c service swift] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:03.841224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f125fe8-3f35-489c-8d54-9d08da71af9c service swift] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:03.846439 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b19ff-f062-4ccb-8e0f-31a1855d0e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:03.847092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b19ff-f062-4ccb-8e0f-31a1855d0e78 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.847381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b19ff-f062-4ccb-8e0f-31a1855d0e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.847664 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b19ff-f062-4ccb-8e0f-31a1855d0e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.848426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b19ff-f062-4ccb-8e0f-31a1855d0e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:03.850019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b19ff-f062-4ccb-8e0f-31a1855d0e78 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:03.860168 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1373/2721] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:03.864220 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed60b6-718e-43e9-b94f-3fdd7f120a0b admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:03.874050 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed60b6-718e-43e9-b94f-3fdd7f120a0b admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:03.878617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3deee-6544-4a64-93ab-d9c727c4dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:03.879481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3deee-6544-4a64-93ab-d9c727c4dae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.879786 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3deee-6544-4a64-93ab-d9c727c4dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.880067 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3deee-6544-4a64-93ab-d9c727c4dae5 admin admin] PATH_INFO: `/v3/projects/7d8c4bbfb9094073ade3ea83c546a271/users/1d18006b2e964d9c9c687e58febbe8ed/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.895157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3deee-6544-4a64-93ab-d9c727c4dae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8c4bbfb9094073ade3ea83c546a271, user_id=1d18006b2e964d9c9c687e58febbe8ed, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:03.897827 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3deee-6544-4a64-93ab-d9c727c4dae5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:03.976452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1349/2722] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:47:03 2022] PUT /identity/v3/projects/7d8c4bbfb9094073ade3ea83c546a271/users/1d18006b2e964d9c9c687e58febbe8ed/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:03.987574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd4479-6640-4b20-815b-77d545d37533 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.987981 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd4479-6640-4b20-815b-77d545d37533 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.988265 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd4479-6640-4b20-815b-77d545d37533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:04.016278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c8bd4479-6640-4b20-815b-77d545d37533 None None] MFA Rules not processed for user `1d18006b2e964d9c9c687e58febbe8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:04.017485 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c8bd4479-6640-4b20-815b-77d545d37533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:04.097130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1374/2723] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:04.108721 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3deee-6544-4a64-93ab-d9c727c4dae5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:04.110426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f7d3deee-6544-4a64-93ab-d9c727c4dae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:04.174566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3deee-6544-4a64-93ab-d9c727c4dae5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:04.178319 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd405f2-3261-4938-8c48-c70da7da1902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:04.179013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd405f2-3261-4938-8c48-c70da7da1902 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:04.179351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd405f2-3261-4938-8c48-c70da7da1902 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:04.179642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd405f2-3261-4938-8c48-c70da7da1902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:04.188013 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd405f2-3261-4938-8c48-c70da7da1902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:04.189438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd405f2-3261-4938-8c48-c70da7da1902 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:04.198631 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1350/2724] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:04.467396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178c61e-230e-471d-98e1-96a518100b1c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:04.467688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178c61e-230e-471d-98e1-96a518100b1c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:04.468005 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178c61e-230e-471d-98e1-96a518100b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:04.485822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7178c61e-230e-471d-98e1-96a518100b1c None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:04.487022 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7178c61e-230e-471d-98e1-96a518100b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:04.495699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=100 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:04.542797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1375/2725] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:47:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:04.554760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd405f2-3261-4938-8c48-c70da7da1902 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:04.621828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd405f2-3261-4938-8c48-c70da7da1902 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:04.627094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce93552-549c-4fe5-8c3b-f2c6c55cfa47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:04.627879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce93552-549c-4fe5-8c3b-f2c6c55cfa47 service swift] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:04.628057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce93552-549c-4fe5-8c3b-f2c6c55cfa47 service swift] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:04.628340 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce93552-549c-4fe5-8c3b-f2c6c55cfa47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:04.636449 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce93552-549c-4fe5-8c3b-f2c6c55cfa47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:04.638565 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce93552-549c-4fe5-8c3b-f2c6c55cfa47 service swift] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:04.646530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1351/2726] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:47:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:47:05.275212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29dd5-9e5a-49f7-bc2c-c513fe05ee92 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:05.275789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29dd5-9e5a-49f7-bc2c-c513fe05ee92 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:05.275789 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29dd5-9e5a-49f7-bc2c-c513fe05ee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:05.296269 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-9df29dd5-9e5a-49f7-bc2c-c513fe05ee92 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:05.297674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9df29dd5-9e5a-49f7-bc2c-c513fe05ee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:05.305598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1376/2727] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 16 00:47:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:05.318887 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce93552-549c-4fe5-8c3b-f2c6c55cfa47 service swift] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:05.329806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce93552-549c-4fe5-8c3b-f2c6c55cfa47 service swift] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:05.335024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a4963-323d-4890-be69-ccaa0a4cdf6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:05.335688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a4963-323d-4890-be69-ccaa0a4cdf6e service swift] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:05.336009 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a4963-323d-4890-be69-ccaa0a4cdf6e service swift] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:05.336291 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a4963-323d-4890-be69-ccaa0a4cdf6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:05.345415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a4963-323d-4890-be69-ccaa0a4cdf6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:05.347024 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a4963-323d-4890-be69-ccaa0a4cdf6e service swift] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:05.356286 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1352/2728] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:47:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:47:08.143332 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29dd5-9e5a-49f7-bc2c-c513fe05ee92 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:08.144810 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-9df29dd5-9e5a-49f7-bc2c-c513fe05ee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:08.218014 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29dd5-9e5a-49f7-bc2c-c513fe05ee92 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:08.222829 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:08.223699 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:08.224010 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:08.224284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] PATH_INFO: `/v3/users/97b604a0839b42489ed8366d859b21c5` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:08.225578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b604a0839b42489ed8366d859b21c5)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:08.227502 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:08.430885 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b604a0839b42489ed8366d859b21c5'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:08.431476 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b604a0839b42489ed8366d859b21c5'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:08.438256 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b604a0839b42489ed8366d859b21c5'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:08.592459 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b604a0839b42489ed8366d859b21c5'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:08.605158 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b604a0839b42489ed8366d859b21c5'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:08.611028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1377/2729] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:47:08 2022] DELETE /identity/v3/users/97b604a0839b42489ed8366d859b21c5 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:08.615659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193eb75-e035-4689-9a65-919366c1fb15 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:08.616169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193eb75-e035-4689-9a65-919366c1fb15 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:08.616277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193eb75-e035-4689-9a65-919366c1fb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:08.628775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:08.634563 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8193eb75-e035-4689-9a65-919366c1fb15 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:08.635773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8193eb75-e035-4689-9a65-919366c1fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:08.693066 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1353/2730] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:08.703170 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:08.704599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:08.739099 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:08.761661 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00b997-4457-4a32-a3ca-3700539f89a0 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:08.766401 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3807de-1e76-401e-9cca-9dbeb7d66c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:08.767039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3807de-1e76-401e-9cca-9dbeb7d66c79 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:08.767323 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3807de-1e76-401e-9cca-9dbeb7d66c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:08.767604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3807de-1e76-401e-9cca-9dbeb7d66c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:08.777097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3807de-1e76-401e-9cca-9dbeb7d66c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:08.778540 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3807de-1e76-401e-9cca-9dbeb7d66c79 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:08.787947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1378/2731] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:09.008975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193eb75-e035-4689-9a65-919366c1fb15 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:09.010969 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8193eb75-e035-4689-9a65-919366c1fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:09.022847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193eb75-e035-4689-9a65-919366c1fb15 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:09.028149 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:09.029309 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.029590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.029870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] PATH_INFO: `/v3/projects/6ddce30006bd454b90d99dd91f530da3` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.031254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ddce30006bd454b90d99dd91f530da3)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:09.033259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:09.184433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ddce30006bd454b90d99dd91f530da3', 'request_id': 'req-70372cee-92c0-4e74-bdce-110cb28eb4f5'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.191267 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ddce30006bd454b90d99dd91f530da3', 'request_id': 'req-70372cee-92c0-4e74-bdce-110cb28eb4f5'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.269392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ddce30006bd454b90d99dd91f530da3', 'request_id': 'req-70372cee-92c0-4e74-bdce-110cb28eb4f5'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.281579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] The token cache is being invalidate because project 6ddce30006bd454b90d99dd91f530da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:47:09.281865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.282494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-70372cee-92c0-4e74-bdce-110cb28eb4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.284120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1354/2732] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:47:09 2022] DELETE /identity/v3/projects/6ddce30006bd454b90d99dd91f530da3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:47:09.290295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367ec0-c9e4-48e6-9008-c64a4797ced7 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.290813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367ec0-c9e4-48e6-9008-c64a4797ced7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.290927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367ec0-c9e4-48e6-9008-c64a4797ced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.310705 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-2f367ec0-c9e4-48e6-9008-c64a4797ced7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:09.311930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-2f367ec0-c9e4-48e6-9008-c64a4797ced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:09.370911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1379/2733] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:09.379325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69325626-f6a1-4978-a082-aeb4a05a25ca None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.379620 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69325626-f6a1-4978-a082-aeb4a05a25ca None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.379955 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69325626-f6a1-4978-a082-aeb4a05a25ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.399120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-69325626-f6a1-4978-a082-aeb4a05a25ca None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:09.401538 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-69325626-f6a1-4978-a082-aeb4a05a25ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:09.409156 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1355/2734] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:09.413388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f367ec0-c9e4-48e6-9008-c64a4797ced7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:09.424252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f367ec0-c9e4-48e6-9008-c64a4797ced7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:09.428961 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd61a-dc47-460b-9894-eb79b32e468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:09.429608 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd61a-dc47-460b-9894-eb79b32e468f admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.429891 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd61a-dc47-460b-9894-eb79b32e468f admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.430168 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd61a-dc47-460b-9894-eb79b32e468f admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.430902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fd61a-dc47-460b-9894-eb79b32e468f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:47:09.431210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fd61a-dc47-460b-9894-eb79b32e468f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:09.432833 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fd61a-dc47-460b-9894-eb79b32e468f admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:09.444108 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1380/2735] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:47:09.448321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69325626-f6a1-4978-a082-aeb4a05a25ca None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:09.457442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69325626-f6a1-4978-a082-aeb4a05a25ca None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:09.462294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3f703-51f9-4aca-ae4e-e3b552afd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:09.462940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3f703-51f9-4aca-ae4e-e3b552afd362 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.463224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3f703-51f9-4aca-ae4e-e3b552afd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.463529 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3f703-51f9-4aca-ae4e-e3b552afd362 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.464271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3f703-51f9-4aca-ae4e-e3b552afd362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:09.466194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3f703-51f9-4aca-ae4e-e3b552afd362 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:09.565881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1356/2736] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:47:09 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:47:09.569933 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd61a-dc47-460b-9894-eb79b32e468f admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:09.579872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd61a-dc47-460b-9894-eb79b32e468f admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:09.635261 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2fedd-ffe8-4287-be03-f7687b022bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:09.636013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2fedd-ffe8-4287-be03-f7687b022bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.636291 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2fedd-ffe8-4287-be03-f7687b022bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.636633 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2fedd-ffe8-4287-be03-f7687b022bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.637365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2fedd-ffe8-4287-be03-f7687b022bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:09.640134 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2fedd-ffe8-4287-be03-f7687b022bc0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:09.775610 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1381/2737] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:47:09 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:47:09.779998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3f703-51f9-4aca-ae4e-e3b552afd362 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:09.790245 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3f703-51f9-4aca-ae4e-e3b552afd362 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:09.794914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e05828-c3dd-46aa-b016-f3ec371673f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:09.795607 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e05828-c3dd-46aa-b016-f3ec371673f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.796821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e05828-c3dd-46aa-b016-f3ec371673f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.796821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e05828-c3dd-46aa-b016-f3ec371673f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.797246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e05828-c3dd-46aa-b016-f3ec371673f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:09.798931 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e05828-c3dd-46aa-b016-f3ec371673f5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:09.809546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1357/2738] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:09.813425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2fedd-ffe8-4287-be03-f7687b022bc0 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:09.823419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2fedd-ffe8-4287-be03-f7687b022bc0 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:09.828585 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe01f43-3c61-4dd5-bd7d-a1847a68efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:09.829228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01f43-3c61-4dd5-bd7d-a1847a68efda admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.829520 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01f43-3c61-4dd5-bd7d-a1847a68efda admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.829800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01f43-3c61-4dd5-bd7d-a1847a68efda admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.830518 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe01f43-3c61-4dd5-bd7d-a1847a68efda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:09.832157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe01f43-3c61-4dd5-bd7d-a1847a68efda admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:09.842623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1382/2739] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:09.846544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e05828-c3dd-46aa-b016-f3ec371673f5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:09.856568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e05828-c3dd-46aa-b016-f3ec371673f5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:09.861057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e2f80-b7dd-461b-b22b-ce7083982c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:09.861950 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e2f80-b7dd-461b-b22b-ce7083982c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.862251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e2f80-b7dd-461b-b22b-ce7083982c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.862513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e2f80-b7dd-461b-b22b-ce7083982c6e admin admin] PATH_INFO: `/v3/projects/0e24e679d8204d248892ce4328557c8c/users/f07248b03aa14db19f896333e2064f2d/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.876595 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e2f80-b7dd-461b-b22b-ce7083982c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e24e679d8204d248892ce4328557c8c, user_id=f07248b03aa14db19f896333e2064f2d, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:09.879246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e2f80-b7dd-461b-b22b-ce7083982c6e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:09.942987 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1358/2740] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:47:09 2022] PUT /identity/v3/projects/0e24e679d8204d248892ce4328557c8c/users/f07248b03aa14db19f896333e2064f2d/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:09.948041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559851b-6ebf-4674-a656-b6c5c353b79c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.948448 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559851b-6ebf-4674-a656-b6c5c353b79c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.948739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559851b-6ebf-4674-a656-b6c5c353b79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.967177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4559851b-6ebf-4674-a656-b6c5c353b79c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:09.968441 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4559851b-6ebf-4674-a656-b6c5c353b79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:10.001550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:10.027059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1383/2741] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:10.036750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e2f80-b7dd-461b-b22b-ce7083982c6e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:10.038683 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4e7e2f80-b7dd-461b-b22b-ce7083982c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:10.071369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:10.097858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e2f80-b7dd-461b-b22b-ce7083982c6e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:10.101554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e72f-fba5-4a3b-a420-6908a5f5a69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:10.102266 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e72f-fba5-4a3b-a420-6908a5f5a69b service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:10.102760 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e72f-fba5-4a3b-a420-6908a5f5a69b service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:10.103219 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e72f-fba5-4a3b-a420-6908a5f5a69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:10.112472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3e72f-fba5-4a3b-a420-6908a5f5a69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:10.113988 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3e72f-fba5-4a3b-a420-6908a5f5a69b service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:10.123953 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1359/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:15.230054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aec7d-9a89-4df6-8b4f-697e28ee86a1 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:15.230540 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aec7d-9a89-4df6-8b4f-697e28ee86a1 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:15.230771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aec7d-9a89-4df6-8b4f-697e28ee86a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:15.260755 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-d71aec7d-9a89-4df6-8b4f-697e28ee86a1 None None] MFA Rules not processed for user `f07248b03aa14db19f896333e2064f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:15.262054 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-d71aec7d-9a89-4df6-8b4f-697e28ee86a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:15.366067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1384/2743] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:15.369507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e72f-fba5-4a3b-a420-6908a5f5a69b service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:15.383185 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e72f-fba5-4a3b-a420-6908a5f5a69b service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:15.389057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e757edc-5860-4508-b81d-a892a18dcaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:15.394762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e757edc-5860-4508-b81d-a892a18dcaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:15.394762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e757edc-5860-4508-b81d-a892a18dcaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:15.394762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e757edc-5860-4508-b81d-a892a18dcaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:15.394762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e757edc-5860-4508-b81d-a892a18dcaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:15.394762 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e757edc-5860-4508-b81d-a892a18dcaa5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:15.462544 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1360/2744] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:47:15 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:47:15.463691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aec7d-9a89-4df6-8b4f-697e28ee86a1 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:15.475560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aec7d-9a89-4df6-8b4f-697e28ee86a1 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:15.548753 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08460b17-647e-4186-8d98-a5d638bb3eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:15.549427 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08460b17-647e-4186-8d98-a5d638bb3eeb admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:15.549711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08460b17-647e-4186-8d98-a5d638bb3eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:15.550007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08460b17-647e-4186-8d98-a5d638bb3eeb admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:15.550724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08460b17-647e-4186-8d98-a5d638bb3eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:15.552682 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08460b17-647e-4186-8d98-a5d638bb3eeb admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:15.650969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1385/2745] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:47:15 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:47:15.655505 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e757edc-5860-4508-b81d-a892a18dcaa5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:15.666264 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e757edc-5860-4508-b81d-a892a18dcaa5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:15.670998 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85be02-f18b-4f37-9f2e-f26c32509c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:15.671669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85be02-f18b-4f37-9f2e-f26c32509c34 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:15.672000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85be02-f18b-4f37-9f2e-f26c32509c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:15.672278 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85be02-f18b-4f37-9f2e-f26c32509c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:15.673008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85be02-f18b-4f37-9f2e-f26c32509c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:15.674617 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85be02-f18b-4f37-9f2e-f26c32509c34 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:15.686404 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1361/2746] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:15.690437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08460b17-647e-4186-8d98-a5d638bb3eeb admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:15.701727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08460b17-647e-4186-8d98-a5d638bb3eeb admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:15.706400 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d0978-e910-4397-b62a-4d8ffabbc62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:15.707284 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d0978-e910-4397-b62a-4d8ffabbc62e admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:15.707563 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d0978-e910-4397-b62a-4d8ffabbc62e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:15.707867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d0978-e910-4397-b62a-4d8ffabbc62e admin admin] PATH_INFO: `/v3/projects/c09a2fcdeb644fde8de8555f4aedd2c3/users/d6f1985fcf444662a256ca0ee3c79eec/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:15.752865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d0978-e910-4397-b62a-4d8ffabbc62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09a2fcdeb644fde8de8555f4aedd2c3, user_id=d6f1985fcf444662a256ca0ee3c79eec, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:15.752865 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d0978-e910-4397-b62a-4d8ffabbc62e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:15.866159 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1386/2747] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:47:15 2022] PUT /identity/v3/projects/c09a2fcdeb644fde8de8555f4aedd2c3/users/d6f1985fcf444662a256ca0ee3c79eec/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:15.870338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85be02-f18b-4f37-9f2e-f26c32509c34 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:15.882105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85be02-f18b-4f37-9f2e-f26c32509c34 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:15.950168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407905-0dd0-48ab-8ec9-c162099ba5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:15.951527 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407905-0dd0-48ab-8ec9-c162099ba5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:15.951942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407905-0dd0-48ab-8ec9-c162099ba5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:15.952318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407905-0dd0-48ab-8ec9-c162099ba5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:15.953287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74407905-0dd0-48ab-8ec9-c162099ba5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:15.954968 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74407905-0dd0-48ab-8ec9-c162099ba5e5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:15.967750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1362/2748] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:15.971995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d0978-e910-4397-b62a-4d8ffabbc62e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:15.984235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d0978-e910-4397-b62a-4d8ffabbc62e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:15.990583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56fb84-91c7-49c2-9bd1-8e247330739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:15.991486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56fb84-91c7-49c2-9bd1-8e247330739d admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:15.991799 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56fb84-91c7-49c2-9bd1-8e247330739d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:15.992086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56fb84-91c7-49c2-9bd1-8e247330739d admin admin] PATH_INFO: `/v3/projects/c09a2fcdeb644fde8de8555f4aedd2c3/users/d6f1985fcf444662a256ca0ee3c79eec/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:15.994496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56fb84-91c7-49c2-9bd1-8e247330739d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09a2fcdeb644fde8de8555f4aedd2c3, user_id=d6f1985fcf444662a256ca0ee3c79eec, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:15.997360 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56fb84-91c7-49c2-9bd1-8e247330739d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:16.012118 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1387/2749] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:47:15 2022] PUT /identity/v3/projects/c09a2fcdeb644fde8de8555f4aedd2c3/users/d6f1985fcf444662a256ca0ee3c79eec/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:19.417471 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407905-0dd0-48ab-8ec9-c162099ba5e5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:19.419957 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-74407905-0dd0-48ab-8ec9-c162099ba5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:19.433202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407905-0dd0-48ab-8ec9-c162099ba5e5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:19.499363 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:19.500380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:19.500743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:19.501100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] PATH_INFO: `/v3/users/1d18006b2e964d9c9c687e58febbe8ed` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:19.502472 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d18006b2e964d9c9c687e58febbe8ed)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:19.504460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:19.742743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:19.755535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d18006b2e964d9c9c687e58febbe8ed'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:19.756559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d18006b2e964d9c9c687e58febbe8ed'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:19.878323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d18006b2e964d9c9c687e58febbe8ed'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:19.886385 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d18006b2e964d9c9c687e58febbe8ed'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:19.899248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d18006b2e964d9c9c687e58febbe8ed'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:19.906568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1363/2750] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:47:19 2022] DELETE /identity/v3/users/1d18006b2e964d9c9c687e58febbe8ed => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:19.910908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67ffdb-42bd-443e-b2ba-bc2cd2356763 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:19.922051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67ffdb-42bd-443e-b2ba-bc2cd2356763 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:19.922051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67ffdb-42bd-443e-b2ba-bc2cd2356763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:19.950287 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-3f67ffdb-42bd-443e-b2ba-bc2cd2356763 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:19.951758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3f67ffdb-42bd-443e-b2ba-bc2cd2356763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:19.978013 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:20.031940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1388/2751] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:20.052907 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:20.054832 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:20.136100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10463b0-ceb1-4e2a-9e31-697eecd92080 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:20.140979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa2d56-9d33-4b44-a42c-902074ae148e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:20.141759 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa2d56-9d33-4b44-a42c-902074ae148e service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:20.142170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa2d56-9d33-4b44-a42c-902074ae148e service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:20.142578 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa2d56-9d33-4b44-a42c-902074ae148e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:20.153182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa2d56-9d33-4b44-a42c-902074ae148e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:20.155369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa2d56-9d33-4b44-a42c-902074ae148e service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:20.166253 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1364/2752] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:20.786908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67ffdb-42bd-443e-b2ba-bc2cd2356763 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:20.789871 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-3f67ffdb-42bd-443e-b2ba-bc2cd2356763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:20.807062 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67ffdb-42bd-443e-b2ba-bc2cd2356763 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:20.813429 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:20.814731 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:20.815364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:20.815876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] PATH_INFO: `/v3/projects/7d8c4bbfb9094073ade3ea83c546a271` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:20.817770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8c4bbfb9094073ade3ea83c546a271)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:20.819763 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:20.938221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8c4bbfb9094073ade3ea83c546a271', 'request_id': 'req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:20.954253 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8c4bbfb9094073ade3ea83c546a271', 'request_id': 'req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:20.967993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8c4bbfb9094073ade3ea83c546a271', 'request_id': 'req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:21.050249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] The token cache is being invalidate because project 7d8c4bbfb9094073ade3ea83c546a271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:47:21.050547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:21.051224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-03906bc7-4090-4ca5-97e2-e12ebcdea8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:21.054114 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1389/2753] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:47:20 2022] DELETE /identity/v3/projects/7d8c4bbfb9094073ade3ea83c546a271 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:21.059120 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef05efd-090c-41b3-b3a3-dde01588cec8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.059626 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef05efd-090c-41b3-b3a3-dde01588cec8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.059959 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef05efd-090c-41b3-b3a3-dde01588cec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.079877 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9ef05efd-090c-41b3-b3a3-dde01588cec8 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:21.081229 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9ef05efd-090c-41b3-b3a3-dde01588cec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:21.156549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1365/2754] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:47:21.164872 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958dc2-f996-4802-922f-2a66da828b17 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.165997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958dc2-f996-4802-922f-2a66da828b17 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.166730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958dc2-f996-4802-922f-2a66da828b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.190388 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-c6958dc2-f996-4802-922f-2a66da828b17 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:21.195348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c6958dc2-f996-4802-922f-2a66da828b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:21.206932 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1390/2755] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:21.211667 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef05efd-090c-41b3-b3a3-dde01588cec8 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:21.222910 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef05efd-090c-41b3-b3a3-dde01588cec8 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:21.227842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530da5ad-1181-432d-b295-26f3a215f063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:21.228507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530da5ad-1181-432d-b295-26f3a215f063 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.228854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530da5ad-1181-432d-b295-26f3a215f063 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.229082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530da5ad-1181-432d-b295-26f3a215f063 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.229834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530da5ad-1181-432d-b295-26f3a215f063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:47:21.230141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530da5ad-1181-432d-b295-26f3a215f063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:21.231879 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530da5ad-1181-432d-b295-26f3a215f063 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:21.245770 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1366/2756] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:47:21.250641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6958dc2-f996-4802-922f-2a66da828b17 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:21.261187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6958dc2-f996-4802-922f-2a66da828b17 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:21.268124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339fd15-22be-4dc2-bf5a-e5f645c77340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:21.268881 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339fd15-22be-4dc2-bf5a-e5f645c77340 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.269243 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339fd15-22be-4dc2-bf5a-e5f645c77340 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.269523 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339fd15-22be-4dc2-bf5a-e5f645c77340 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.270228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339fd15-22be-4dc2-bf5a-e5f645c77340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:21.272201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339fd15-22be-4dc2-bf5a-e5f645c77340 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:21.451311 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1391/2757] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:47:21 2022] POST /identity/v3/projects => generated 371 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:47:21.455186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530da5ad-1181-432d-b295-26f3a215f063 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:21.465338 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530da5ad-1181-432d-b295-26f3a215f063 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:21.515043 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:21.548416 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47616c-baf0-40f7-8a9e-983343bfb569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:21.549218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47616c-baf0-40f7-8a9e-983343bfb569 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.550418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47616c-baf0-40f7-8a9e-983343bfb569 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.550954 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47616c-baf0-40f7-8a9e-983343bfb569 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.552203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47616c-baf0-40f7-8a9e-983343bfb569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:21.554347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47616c-baf0-40f7-8a9e-983343bfb569 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:21.680124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1367/2758] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:47:21 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:47:21.681466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339fd15-22be-4dc2-bf5a-e5f645c77340 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:21.697151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339fd15-22be-4dc2-bf5a-e5f645c77340 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:21.704111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada65cb8-8d5f-4828-a522-18f8c747edc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:21.711558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada65cb8-8d5f-4828-a522-18f8c747edc3 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.711558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada65cb8-8d5f-4828-a522-18f8c747edc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.711558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada65cb8-8d5f-4828-a522-18f8c747edc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.711558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada65cb8-8d5f-4828-a522-18f8c747edc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:21.711558 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada65cb8-8d5f-4828-a522-18f8c747edc3 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:21.724859 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1392/2759] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:21.728741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47616c-baf0-40f7-8a9e-983343bfb569 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:21.742460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47616c-baf0-40f7-8a9e-983343bfb569 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:21.753254 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5381fe-b92e-492f-896d-efda1fa462f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:21.753960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5381fe-b92e-492f-896d-efda1fa462f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.754248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5381fe-b92e-492f-896d-efda1fa462f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.754535 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5381fe-b92e-492f-896d-efda1fa462f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.755328 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5381fe-b92e-492f-896d-efda1fa462f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:21.756943 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5381fe-b92e-492f-896d-efda1fa462f4 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:21.771107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1368/2760] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:47:21.776384 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada65cb8-8d5f-4828-a522-18f8c747edc3 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:21.789021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada65cb8-8d5f-4828-a522-18f8c747edc3 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:21.796208 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89410acf-e20a-465f-9cca-22b37e6d9749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:21.798103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89410acf-e20a-465f-9cca-22b37e6d9749 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.798579 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89410acf-e20a-465f-9cca-22b37e6d9749 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.799040 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89410acf-e20a-465f-9cca-22b37e6d9749 admin admin] PATH_INFO: `/v3/projects/625f987db5db45fca20415864da6deaf/users/fd055816415c4eb8b25d9795d2bc83d7/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.850690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89410acf-e20a-465f-9cca-22b37e6d9749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625f987db5db45fca20415864da6deaf, user_id=fd055816415c4eb8b25d9795d2bc83d7, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:21.854622 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89410acf-e20a-465f-9cca-22b37e6d9749 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:21.877873 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c480843-606d-44d0-8952-4dc9c77b4b05 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.878170 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c480843-606d-44d0-8952-4dc9c77b4b05 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.878525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c480843-606d-44d0-8952-4dc9c77b4b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.922590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-9c480843-606d-44d0-8952-4dc9c77b4b05 None None] MFA Rules not processed for user `d6f1985fcf444662a256ca0ee3c79eec`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:21.924415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9c480843-606d-44d0-8952-4dc9c77b4b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:21.958350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1393/2761] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:47:21 2022] PUT /identity/v3/projects/625f987db5db45fca20415864da6deaf/users/fd055816415c4eb8b25d9795d2bc83d7/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:21.966431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3986f38-f208-40ab-a4b7-a461e669ffb7 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:21.966965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3986f38-f208-40ab-a4b7-a461e669ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:21.967582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3986f38-f208-40ab-a4b7-a461e669ffb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:21.995540 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e3986f38-f208-40ab-a4b7-a461e669ffb7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:21.997834 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e3986f38-f208-40ab-a4b7-a461e669ffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:22.029833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1369/2762] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:47:22.051348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:22.053682 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c480843-606d-44d0-8952-4dc9c77b4b05 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:22.055455 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-9c480843-606d-44d0-8952-4dc9c77b4b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:22.117490 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1394/2763] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:22.123641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3986f38-f208-40ab-a4b7-a461e669ffb7 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:22.125202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e3986f38-f208-40ab-a4b7-a461e669ffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:22.161081 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c480843-606d-44d0-8952-4dc9c77b4b05 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:22.202771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3986f38-f208-40ab-a4b7-a461e669ffb7 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:22.206898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d3cd2-c3d5-40f1-b950-640c5ee4d348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:22.207600 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d3cd2-c3d5-40f1-b950-640c5ee4d348 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:22.207917 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d3cd2-c3d5-40f1-b950-640c5ee4d348 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:22.208199 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d3cd2-c3d5-40f1-b950-640c5ee4d348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:22.210143 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:22.223049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d3cd2-c3d5-40f1-b950-640c5ee4d348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:22.224786 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d3cd2-c3d5-40f1-b950-640c5ee4d348 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:22.235777 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1395/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:47:22.250642 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:22.252738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:22.252738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:22.252738 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:22.254204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:22.317196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:22.318819 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:22.328599 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1370/2765] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:47:23.746768 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e421-0658-46f8-84b4-b828f7bb36b2 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:23.747832 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e421-0658-46f8-84b4-b828f7bb36b2 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:23.748420 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e421-0658-46f8-84b4-b828f7bb36b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:23.776526 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-1307e421-0658-46f8-84b4-b828f7bb36b2 None None] MFA Rules not processed for user `fd055816415c4eb8b25d9795d2bc83d7`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:23.777742 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1307e421-0658-46f8-84b4-b828f7bb36b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:23.849623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1396/2766] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:23.860981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:23.862436 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:23.938833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328bd4d-d10a-4796-a0fe-881120c0e69c service nova] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:23.942427 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6417d4-5b0a-4492-8824-5430b919dbc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:23.943069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6417d4-5b0a-4492-8824-5430b919dbc8 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:23.944384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6417d4-5b0a-4492-8824-5430b919dbc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:23.944384 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6417d4-5b0a-4492-8824-5430b919dbc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:23.953494 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6417d4-5b0a-4492-8824-5430b919dbc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:23.954530 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6417d4-5b0a-4492-8824-5430b919dbc8 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:23.964855 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1371/2767] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:25.319085 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9df5-4dd1-4e35-9d64-81ed04b8ca43 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:25.319638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9df5-4dd1-4e35-9d64-81ed04b8ca43 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:25.319638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9df5-4dd1-4e35-9d64-81ed04b8ca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:25.337198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-05dc9df5-4dd1-4e35-9d64-81ed04b8ca43 None None] MFA Rules not processed for user `f07248b03aa14db19f896333e2064f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:25.338653 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-05dc9df5-4dd1-4e35-9d64-81ed04b8ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:25.346335 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1397/2768] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:25.699037 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99c2bb-2555-452d-b5ac-98b402639659 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:25.699546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99c2bb-2555-452d-b5ac-98b402639659 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:25.702434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99c2bb-2555-452d-b5ac-98b402639659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:25.718757 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0d99c2bb-2555-452d-b5ac-98b402639659 None None] MFA Rules not processed for user `fd055816415c4eb8b25d9795d2bc83d7`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:25.720558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0d99c2bb-2555-452d-b5ac-98b402639659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:25.727501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1372/2769] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:25.968510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9df5-4dd1-4e35-9d64-81ed04b8ca43 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:25.970037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-05dc9df5-4dd1-4e35-9d64-81ed04b8ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:25.983201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9df5-4dd1-4e35-9d64-81ed04b8ca43 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:25.986732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:25.987416 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:25.987690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:25.987994 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:25.989713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:26.000698 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:26.002063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:26.011691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1398/2770] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:35.713272 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=65 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:36.007717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=75 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:45.558250 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1c0c-f74a-41ca-9ada-017223aeb10d None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:45.558783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1c0c-f74a-41ca-9ada-017223aeb10d None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:45.558890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1c0c-f74a-41ca-9ada-017223aeb10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:45.578207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-540d1c0c-f74a-41ca-9ada-017223aeb10d None None] MFA Rules not processed for user `fd055816415c4eb8b25d9795d2bc83d7`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:45.579478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-540d1c0c-f74a-41ca-9ada-017223aeb10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:45.586561 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1373/2771] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:48.003508 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:48.007902 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:48.036327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389d639-17c1-453c-a114-1b70cfc656fa service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:48.045015 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe396d-b4d6-4b8d-988b-996358d794cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:48.045680 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe396d-b4d6-4b8d-988b-996358d794cd service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:48.046006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe396d-b4d6-4b8d-988b-996358d794cd service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:48.046336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe396d-b4d6-4b8d-988b-996358d794cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:48.048506 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-77fe396d-b4d6-4b8d-988b-996358d794cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:48.068455 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe396d-b4d6-4b8d-988b-996358d794cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:48.070495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe396d-b4d6-4b8d-988b-996358d794cd service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:48.088185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1399/2772] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:52.447064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e017f-2f3f-40a4-b11b-5e8b48035737 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:52.447064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e017f-2f3f-40a4-b11b-5e8b48035737 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:52.447624 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e017f-2f3f-40a4-b11b-5e8b48035737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:52.465076 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-610e017f-2f3f-40a4-b11b-5e8b48035737 None None] MFA Rules not processed for user `f42acc9bbc544aa78253a59f89faa94c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:47:52.466288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-610e017f-2f3f-40a4-b11b-5e8b48035737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:52.523204 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1374/2773] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:47:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:47:55.457675 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe396d-b4d6-4b8d-988b-996358d794cd service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:55.467492 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe396d-b4d6-4b8d-988b-996358d794cd service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:55.471623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc038eb-bc7d-414b-90c0-ddf863901ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:55.473586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc038eb-bc7d-414b-90c0-ddf863901ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:55.473586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc038eb-bc7d-414b-90c0-ddf863901ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:55.473586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc038eb-bc7d-414b-90c0-ddf863901ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:55.534165 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc038eb-bc7d-414b-90c0-ddf863901ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:55.535623 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc038eb-bc7d-414b-90c0-ddf863901ae9 service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:55.545183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1400/2774] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:48:02.516659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=28 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:05.540953 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=36 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:06.625729 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24bed-979a-4074-87ca-c8f74e013d9f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:48:06.626160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24bed-979a-4074-87ca-c8f74e013d9f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:48:06.626310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24bed-979a-4074-87ca-c8f74e013d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:48:06.644949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-baa24bed-979a-4074-87ca-c8f74e013d9f None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:48:06.646087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-baa24bed-979a-4074-87ca-c8f74e013d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:48:06.701590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1375/2775] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:48:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:48:06.867213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc038eb-bc7d-414b-90c0-ddf863901ae9 service neutron] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:48:06.868967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-fcc038eb-bc7d-414b-90c0-ddf863901ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:48:06.941599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc038eb-bc7d-414b-90c0-ddf863901ae9 service neutron] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:48:06.947188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa44c68-4c4f-4feb-9a78-3691c3172b59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:48:06.947861 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44c68-4c4f-4feb-9a78-3691c3172b59 service swift] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:48:06.948146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44c68-4c4f-4feb-9a78-3691c3172b59 service swift] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:48:06.948423 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44c68-4c4f-4feb-9a78-3691c3172b59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:48:06.957124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa44c68-4c4f-4feb-9a78-3691c3172b59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:48:06.958771 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa44c68-4c4f-4feb-9a78-3691c3172b59 service swift] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:48:06.967095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1401/2776] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:48:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:48:07.671903 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa24bed-979a-4074-87ca-c8f74e013d9f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:48:07.673547 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-baa24bed-979a-4074-87ca-c8f74e013d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:48:07.759900 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa24bed-979a-4074-87ca-c8f74e013d9f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:48:07.767712 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa809e50-76e5-4b63-b312-b5fca8b9302e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:48:07.769238 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa809e50-76e5-4b63-b312-b5fca8b9302e service placement] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:48:07.769641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa809e50-76e5-4b63-b312-b5fca8b9302e service placement] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:48:07.769981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa809e50-76e5-4b63-b312-b5fca8b9302e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:48:07.771966 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-aa809e50-76e5-4b63-b312-b5fca8b9302e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:48:07.787110 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa809e50-76e5-4b63-b312-b5fca8b9302e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:48:07.789020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa809e50-76e5-4b63-b312-b5fca8b9302e service placement] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:48:07.806445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1376/2777] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:48:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:48:16.963830 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=32 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:17.800463 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=57 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:24.294079 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354397e4-ae62-49f8-b8db-e8c6d211a114 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:48:24.294511 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354397e4-ae62-49f8-b8db-e8c6d211a114 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:48:24.294659 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354397e4-ae62-49f8-b8db-e8c6d211a114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:48:24.311304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-354397e4-ae62-49f8-b8db-e8c6d211a114 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:48:24.313025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-354397e4-ae62-49f8-b8db-e8c6d211a114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:48:24.319972 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1402/2778] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 16 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:48:24.331711 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa809e50-76e5-4b63-b312-b5fca8b9302e service placement] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:48:24.343321 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa809e50-76e5-4b63-b312-b5fca8b9302e service placement] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:48:24.348234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4023d-a7fe-4d8f-a49f-5d4d9082486d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:48:24.348853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4023d-a7fe-4d8f-a49f-5d4d9082486d service swift] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:48:24.349139 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4023d-a7fe-4d8f-a49f-5d4d9082486d service swift] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:48:24.349413 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4023d-a7fe-4d8f-a49f-5d4d9082486d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:48:24.357218 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4023d-a7fe-4d8f-a49f-5d4d9082486d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:48:24.359420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4023d-a7fe-4d8f-a49f-5d4d9082486d service swift] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:48:24.367251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1377/2779] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:48:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:48:27.262271 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354397e4-ae62-49f8-b8db-e8c6d211a114 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:48:27.274845 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354397e4-ae62-49f8-b8db-e8c6d211a114 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:48:27.279513 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:48:27.280437 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:48:27.280722 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:48:27.281001 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] PATH_INFO: `/v3/users/fd055816415c4eb8b25d9795d2bc83d7` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:48:27.282210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd055816415c4eb8b25d9795d2bc83d7)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:48:27.284191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:48:27.440569 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd055816415c4eb8b25d9795d2bc83d7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:27.441176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd055816415c4eb8b25d9795d2bc83d7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:27.447941 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd055816415c4eb8b25d9795d2bc83d7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:27.527527 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd055816415c4eb8b25d9795d2bc83d7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:27.540186 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd055816415c4eb8b25d9795d2bc83d7'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:27.546042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1403/2780] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:48:27 2022] DELETE /identity/v3/users/fd055816415c4eb8b25d9795d2bc83d7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:48:27.792474 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4023d-a7fe-4d8f-a49f-5d4d9082486d service swift] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:48:27.805839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4023d-a7fe-4d8f-a49f-5d4d9082486d service swift] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:48:27.868101 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:48:27.868961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:48:27.869247 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:48:27.869528 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] PATH_INFO: `/v3/projects/625f987db5db45fca20415864da6deaf` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:48:27.870719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625f987db5db45fca20415864da6deaf)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:48:27.872678 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:48:27.981550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625f987db5db45fca20415864da6deaf', 'request_id': 'req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:27.987696 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625f987db5db45fca20415864da6deaf', 'request_id': 'req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:28.087834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625f987db5db45fca20415864da6deaf', 'request_id': 'req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:28.099237 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] The token cache is being invalidate because project 625f987db5db45fca20415864da6deaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:48:28.099526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:28.100179 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:48:28.101716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1378/2781] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:48:27 2022] DELETE /identity/v3/projects/625f987db5db45fca20415864da6deaf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:48:37.542564 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:38.096207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:10.792886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:10.794904 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:10.809281 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f47a6b-6fa9-4e72-bcb4-b0d8a8e51c72 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:10.865379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:10.866249 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:10.866544 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:10.866818 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] PATH_INFO: `/v3/users/f42acc9bbc544aa78253a59f89faa94c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:10.868037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42acc9bbc544aa78253a59f89faa94c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:10.869998 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:11.027841 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42acc9bbc544aa78253a59f89faa94c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.028453 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42acc9bbc544aa78253a59f89faa94c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.035879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42acc9bbc544aa78253a59f89faa94c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.083264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42acc9bbc544aa78253a59f89faa94c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.096157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-f5848e25-2a31-4aa8-82da-3ab996196077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42acc9bbc544aa78253a59f89faa94c'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.102065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1404/2782] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:49:10 2022] DELETE /identity/v3/users/f42acc9bbc544aa78253a59f89faa94c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:11.324716 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:11.326346 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:11.340015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4985-dbd3-4470-9a5f-a2741bd06a00 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:11.398009 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:11.398868 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:11.399151 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:11.399429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] PATH_INFO: `/v3/projects/df8d39efb8ca4d968a169b22036f84c3` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:11.400634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8d39efb8ca4d968a169b22036f84c3)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:11.402586 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:11.499946 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8d39efb8ca4d968a169b22036f84c3', 'request_id': 'req-4cb834e2-2e0e-4a08-b226-04dac56daece'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.506133 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8d39efb8ca4d968a169b22036f84c3', 'request_id': 'req-4cb834e2-2e0e-4a08-b226-04dac56daece'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.578176 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8d39efb8ca4d968a169b22036f84c3', 'request_id': 'req-4cb834e2-2e0e-4a08-b226-04dac56daece'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.588771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] The token cache is being invalidate because project df8d39efb8ca4d968a169b22036f84c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:49:11.589063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.589709 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4cb834e2-2e0e-4a08-b226-04dac56daece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:11.591908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1379/2783] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:49:11 2022] DELETE /identity/v3/projects/df8d39efb8ca4d968a169b22036f84c3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:11.597061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237251b-9d98-49a5-986c-2a3fe4f2ff15 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:11.597368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237251b-9d98-49a5-986c-2a3fe4f2ff15 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:11.597644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237251b-9d98-49a5-986c-2a3fe4f2ff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:11.615362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5237251b-9d98-49a5-986c-2a3fe4f2ff15 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:11.616603 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5237251b-9d98-49a5-986c-2a3fe4f2ff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:11.675578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1405/2784] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:11.683555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb5dfd-c55b-4796-86b8-480dad257523 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:11.683875 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb5dfd-c55b-4796-86b8-480dad257523 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:11.684158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb5dfd-c55b-4796-86b8-480dad257523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:11.702808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-55bb5dfd-c55b-4796-86b8-480dad257523 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:11.704040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-55bb5dfd-c55b-4796-86b8-480dad257523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:11.712121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1380/2785] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:11.716639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237251b-9d98-49a5-986c-2a3fe4f2ff15 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:11.726122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237251b-9d98-49a5-986c-2a3fe4f2ff15 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:11.730534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a61f4-c5f8-496c-836a-4ac908b5538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:11.731176 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a61f4-c5f8-496c-836a-4ac908b5538d admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:11.731458 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a61f4-c5f8-496c-836a-4ac908b5538d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:11.732394 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a61f4-c5f8-496c-836a-4ac908b5538d admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:11.733059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a61f4-c5f8-496c-836a-4ac908b5538d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:49:11.733368 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a61f4-c5f8-496c-836a-4ac908b5538d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:11.734952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a61f4-c5f8-496c-836a-4ac908b5538d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:11.746336 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1406/2786] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:49:11.751184 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb5dfd-c55b-4796-86b8-480dad257523 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:11.760502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb5dfd-c55b-4796-86b8-480dad257523 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:11.765466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a6380-7f45-4c03-ba5c-5523d1867afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:11.766130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a6380-7f45-4c03-ba5c-5523d1867afa admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:11.770708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a6380-7f45-4c03-ba5c-5523d1867afa admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:11.770708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a6380-7f45-4c03-ba5c-5523d1867afa admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:11.770708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a6380-7f45-4c03-ba5c-5523d1867afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:11.770708 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a6380-7f45-4c03-ba5c-5523d1867afa admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:11.854433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1381/2787] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:49:11 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:11.859665 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a61f4-c5f8-496c-836a-4ac908b5538d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:11.870357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a61f4-c5f8-496c-836a-4ac908b5538d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:11.874372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:11.929697 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546f8c7-5235-40ac-bfea-cff96a34a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:11.930366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f8c7-5235-40ac-bfea-cff96a34a046 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:11.930655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f8c7-5235-40ac-bfea-cff96a34a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:11.930932 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f8c7-5235-40ac-bfea-cff96a34a046 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:11.931658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546f8c7-5235-40ac-bfea-cff96a34a046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:11.933820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546f8c7-5235-40ac-bfea-cff96a34a046 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:12.070807 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1407/2788] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:49:11 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:12.074865 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a6380-7f45-4c03-ba5c-5523d1867afa admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:12.085517 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a6380-7f45-4c03-ba5c-5523d1867afa admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:12.090056 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6b22d-9874-4ff0-8029-22c66c096243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:12.090707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6b22d-9874-4ff0-8029-22c66c096243 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:12.091486 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6b22d-9874-4ff0-8029-22c66c096243 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:12.091792 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6b22d-9874-4ff0-8029-22c66c096243 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:12.092509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6b22d-9874-4ff0-8029-22c66c096243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:12.094091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6b22d-9874-4ff0-8029-22c66c096243 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:12.105525 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1382/2789] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:12.110077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546f8c7-5235-40ac-bfea-cff96a34a046 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:12.120097 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546f8c7-5235-40ac-bfea-cff96a34a046 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:12.124805 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28099c9-7242-4247-a3cc-d07be64192ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:12.125454 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28099c9-7242-4247-a3cc-d07be64192ce admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:12.125741 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28099c9-7242-4247-a3cc-d07be64192ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:12.126019 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28099c9-7242-4247-a3cc-d07be64192ce admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:12.126733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28099c9-7242-4247-a3cc-d07be64192ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:12.128369 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28099c9-7242-4247-a3cc-d07be64192ce admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:12.138927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1408/2790] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:12.142847 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6b22d-9874-4ff0-8029-22c66c096243 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:12.152571 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6b22d-9874-4ff0-8029-22c66c096243 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:12.157640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45c04d-adc1-43c1-a7d8-e8e0f6789f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:12.158492 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45c04d-adc1-43c1-a7d8-e8e0f6789f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:12.158771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45c04d-adc1-43c1-a7d8-e8e0f6789f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:12.159045 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45c04d-adc1-43c1-a7d8-e8e0f6789f96 admin admin] PATH_INFO: `/v3/projects/850292f743864872a3137f0a8b6c10a2/users/1086ecadffc24ec08615c07112d614c9/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:12.174433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45c04d-adc1-43c1-a7d8-e8e0f6789f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850292f743864872a3137f0a8b6c10a2, user_id=1086ecadffc24ec08615c07112d614c9, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:12.177192 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45c04d-adc1-43c1-a7d8-e8e0f6789f96 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:12.243372 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1383/2791] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:49:12 2022] PUT /identity/v3/projects/850292f743864872a3137f0a8b6c10a2/users/1086ecadffc24ec08615c07112d614c9/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:12.256798 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5832-e64a-49c9-9d5e-7ef88d87973d None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:12.257128 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5832-e64a-49c9-9d5e-7ef88d87973d None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:12.257434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5832-e64a-49c9-9d5e-7ef88d87973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:12.284749 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e23b5832-e64a-49c9-9d5e-7ef88d87973d None None] MFA Rules not processed for user `1086ecadffc24ec08615c07112d614c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:12.285950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e23b5832-e64a-49c9-9d5e-7ef88d87973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:12.348815 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1409/2792] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:12.360172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45c04d-adc1-43c1-a7d8-e8e0f6789f96 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:12.361802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-de45c04d-adc1-43c1-a7d8-e8e0f6789f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:12.392695 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:12.434514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45c04d-adc1-43c1-a7d8-e8e0f6789f96 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:12.440189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693fac1-71c8-49a5-81ba-d22f2e6e3d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:12.440824 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693fac1-71c8-49a5-81ba-d22f2e6e3d37 service nova] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:12.441109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693fac1-71c8-49a5-81ba-d22f2e6e3d37 service nova] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:12.441387 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693fac1-71c8-49a5-81ba-d22f2e6e3d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:12.449057 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693fac1-71c8-49a5-81ba-d22f2e6e3d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:12.451168 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693fac1-71c8-49a5-81ba-d22f2e6e3d37 service nova] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:12.459809 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1384/2793] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:49:12.672537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b5832-e64a-49c9-9d5e-7ef88d87973d None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:12.733605 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b5832-e64a-49c9-9d5e-7ef88d87973d None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:12.738089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:12.738949 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:12.739232 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:12.739509 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] PATH_INFO: `/v3/users/1086ecadffc24ec08615c07112d614c9` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:12.740717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1086ecadffc24ec08615c07112d614c9)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:12.742646 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:12.758046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:12.914547 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1086ecadffc24ec08615c07112d614c9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:12.915189 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1086ecadffc24ec08615c07112d614c9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:12.922867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1086ecadffc24ec08615c07112d614c9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:12.968559 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1086ecadffc24ec08615c07112d614c9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:12.980379 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1086ecadffc24ec08615c07112d614c9'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:12.986130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1410/2794] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:49:12 2022] DELETE /identity/v3/users/1086ecadffc24ec08615c07112d614c9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:12.990569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743855-f564-4008-bcba-7af54ca81ca7 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:12.990858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743855-f564-4008-bcba-7af54ca81ca7 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:12.991137 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743855-f564-4008-bcba-7af54ca81ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:13.007584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-67743855-f564-4008-bcba-7af54ca81ca7 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:13.008801 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-67743855-f564-4008-bcba-7af54ca81ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:13.068160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1385/2795] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:13.081733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:13.083137 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:13.139238 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767b37-415b-403c-9727-ee1ba4620470 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:13.143067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc1d2c-cb67-44d8-adaa-e41127ca572e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:13.143711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc1d2c-cb67-44d8-adaa-e41127ca572e service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:13.144025 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc1d2c-cb67-44d8-adaa-e41127ca572e service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:13.144306 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc1d2c-cb67-44d8-adaa-e41127ca572e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:13.154077 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc1d2c-cb67-44d8-adaa-e41127ca572e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:13.155505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc1d2c-cb67-44d8-adaa-e41127ca572e service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:13.164973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1411/2796] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:49:13.558745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67743855-f564-4008-bcba-7af54ca81ca7 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:13.560853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-67743855-f564-4008-bcba-7af54ca81ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:13.574041 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67743855-f564-4008-bcba-7af54ca81ca7 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:13.579513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:13.580446 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:13.581180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:13.581180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] PATH_INFO: `/v3/projects/850292f743864872a3137f0a8b6c10a2` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:13.582224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=850292f743864872a3137f0a8b6c10a2)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:13.584287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:13.703811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850292f743864872a3137f0a8b6c10a2', 'request_id': 'req-ba2d9fe7-1a4c-4898-a599-4be6420adb09'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:13.709890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850292f743864872a3137f0a8b6c10a2', 'request_id': 'req-ba2d9fe7-1a4c-4898-a599-4be6420adb09'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:13.772513 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850292f743864872a3137f0a8b6c10a2', 'request_id': 'req-ba2d9fe7-1a4c-4898-a599-4be6420adb09'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:13.783202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] The token cache is being invalidate because project 850292f743864872a3137f0a8b6c10a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:49:13.783497 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:13.784140 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-ba2d9fe7-1a4c-4898-a599-4be6420adb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:13.785754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1386/2797] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:49:13 2022] DELETE /identity/v3/projects/850292f743864872a3137f0a8b6c10a2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:13.790808 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94990-dc02-4678-802a-5a4a61c9a98e None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:13.791102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94990-dc02-4678-802a-5a4a61c9a98e None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:13.791386 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94990-dc02-4678-802a-5a4a61c9a98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:13.808969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-28c94990-dc02-4678-802a-5a4a61c9a98e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:13.810773 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-28c94990-dc02-4678-802a-5a4a61c9a98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:13.868726 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1412/2798] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:13.878150 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053053-31de-44a6-b95e-6f734342d70a None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:13.886083 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053053-31de-44a6-b95e-6f734342d70a None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:13.886083 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053053-31de-44a6-b95e-6f734342d70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:13.897271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-8d053053-31de-44a6-b95e-6f734342d70a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:13.898509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-8d053053-31de-44a6-b95e-6f734342d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:13.906793 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1387/2799] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:13.910883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94990-dc02-4678-802a-5a4a61c9a98e None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:13.921050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94990-dc02-4678-802a-5a4a61c9a98e None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:13.925742 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c6842-bbe1-4322-9e5f-b4c21196ac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:13.926425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c6842-bbe1-4322-9e5f-b4c21196ac12 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:13.926712 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c6842-bbe1-4322-9e5f-b4c21196ac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:13.926993 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c6842-bbe1-4322-9e5f-b4c21196ac12 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:13.927713 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c6842-bbe1-4322-9e5f-b4c21196ac12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:49:13.928055 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c6842-bbe1-4322-9e5f-b4c21196ac12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:13.929662 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c6842-bbe1-4322-9e5f-b4c21196ac12 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:13.946220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1413/2800] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:49:13.950532 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053053-31de-44a6-b95e-6f734342d70a None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:13.959972 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053053-31de-44a6-b95e-6f734342d70a None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:13.964580 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62d969-6a6e-4a02-b8ae-41e39f203eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:13.965222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62d969-6a6e-4a02-b8ae-41e39f203eaf admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:13.965508 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62d969-6a6e-4a02-b8ae-41e39f203eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:13.965787 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62d969-6a6e-4a02-b8ae-41e39f203eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:13.966467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62d969-6a6e-4a02-b8ae-41e39f203eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:13.968417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62d969-6a6e-4a02-b8ae-41e39f203eaf admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:14.043001 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1388/2801] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:49:13 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:49:14.047813 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c6842-bbe1-4322-9e5f-b4c21196ac12 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:14.057764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c6842-bbe1-4322-9e5f-b4c21196ac12 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:14.079139 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:14.115396 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd11ada-89da-44b2-9dd8-4ba91f3d6717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:14.116126 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd11ada-89da-44b2-9dd8-4ba91f3d6717 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:14.116415 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd11ada-89da-44b2-9dd8-4ba91f3d6717 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:14.116894 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd11ada-89da-44b2-9dd8-4ba91f3d6717 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:14.117630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd11ada-89da-44b2-9dd8-4ba91f3d6717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:14.119877 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd11ada-89da-44b2-9dd8-4ba91f3d6717 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:14.208356 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1414/2802] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:49:14 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:49:14.212509 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62d969-6a6e-4a02-b8ae-41e39f203eaf admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:14.223500 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62d969-6a6e-4a02-b8ae-41e39f203eaf admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:14.228275 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a7ff5-a10a-455c-8ed8-7ebf57a71a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:14.228926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a7ff5-a10a-455c-8ed8-7ebf57a71a11 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:14.229214 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a7ff5-a10a-455c-8ed8-7ebf57a71a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:14.229491 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a7ff5-a10a-455c-8ed8-7ebf57a71a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:14.230210 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a7ff5-a10a-455c-8ed8-7ebf57a71a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:14.232429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a7ff5-a10a-455c-8ed8-7ebf57a71a11 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:14.233693 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:14.243246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1389/2803] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:14.247188 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd11ada-89da-44b2-9dd8-4ba91f3d6717 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:14.257295 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd11ada-89da-44b2-9dd8-4ba91f3d6717 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:14.262038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354e2a3-fc53-442c-8870-086e2d3feda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:14.262740 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354e2a3-fc53-442c-8870-086e2d3feda0 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:14.265666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354e2a3-fc53-442c-8870-086e2d3feda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:14.265666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354e2a3-fc53-442c-8870-086e2d3feda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:14.265666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354e2a3-fc53-442c-8870-086e2d3feda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:14.265951 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354e2a3-fc53-442c-8870-086e2d3feda0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:14.275879 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1415/2804] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:14.280305 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a7ff5-a10a-455c-8ed8-7ebf57a71a11 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:14.289797 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a7ff5-a10a-455c-8ed8-7ebf57a71a11 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:14.296790 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007391-5639-4098-873f-098634c6f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:14.297677 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007391-5639-4098-873f-098634c6f467 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:14.297961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007391-5639-4098-873f-098634c6f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:14.298241 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007391-5639-4098-873f-098634c6f467 admin admin] PATH_INFO: `/v3/projects/2af8675e06534f008da8b2531ca690ad/users/d308f5d205414d9bb42e4f806de0ad5b/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:14.312740 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42007391-5639-4098-873f-098634c6f467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af8675e06534f008da8b2531ca690ad, user_id=d308f5d205414d9bb42e4f806de0ad5b, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:14.315378 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42007391-5639-4098-873f-098634c6f467 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:14.380326 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1390/2805] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:49:14 2022] PUT /identity/v3/projects/2af8675e06534f008da8b2531ca690ad/users/d308f5d205414d9bb42e4f806de0ad5b/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:49:14.390616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b42e-5b6d-4828-9e25-e1ade76197dd None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:14.390930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b42e-5b6d-4828-9e25-e1ade76197dd None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:14.391212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b42e-5b6d-4828-9e25-e1ade76197dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:14.417397 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-cb31b42e-5b6d-4828-9e25-e1ade76197dd None None] MFA Rules not processed for user `d308f5d205414d9bb42e4f806de0ad5b`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:14.418594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cb31b42e-5b6d-4828-9e25-e1ade76197dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:14.482245 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1416/2806] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:14.486734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007391-5639-4098-873f-098634c6f467 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:14.548263 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007391-5639-4098-873f-098634c6f467 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:14.552960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d601fa-9d7d-46c0-854e-335cf5322794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:14.553614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d601fa-9d7d-46c0-854e-335cf5322794 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:14.553908 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d601fa-9d7d-46c0-854e-335cf5322794 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:14.554190 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d601fa-9d7d-46c0-854e-335cf5322794 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:14.554912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d601fa-9d7d-46c0-854e-335cf5322794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:14.556856 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d601fa-9d7d-46c0-854e-335cf5322794 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:14.649779 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1391/2807] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:49:14 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:49:14.654533 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31b42e-5b6d-4828-9e25-e1ade76197dd None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:14.665236 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31b42e-5b6d-4828-9e25-e1ade76197dd None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:14.721155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16544382-fc56-44bf-bf1a-e141f65f868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:14.721812 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16544382-fc56-44bf-bf1a-e141f65f868d admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:14.722095 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16544382-fc56-44bf-bf1a-e141f65f868d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:14.722370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16544382-fc56-44bf-bf1a-e141f65f868d admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:14.723038 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16544382-fc56-44bf-bf1a-e141f65f868d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:14.724980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16544382-fc56-44bf-bf1a-e141f65f868d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:14.823897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1417/2808] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:49:14 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:14.828550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d601fa-9d7d-46c0-854e-335cf5322794 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:14.838754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d601fa-9d7d-46c0-854e-335cf5322794 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:14.843426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdf14a-ef91-4db7-8852-8b6f305d99ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:14.844109 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdf14a-ef91-4db7-8852-8b6f305d99ad admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:14.844397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdf14a-ef91-4db7-8852-8b6f305d99ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:14.844674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdf14a-ef91-4db7-8852-8b6f305d99ad admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:14.845389 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdf14a-ef91-4db7-8852-8b6f305d99ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:14.847010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdf14a-ef91-4db7-8852-8b6f305d99ad admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:14.857733 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1392/2809] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:14.861735 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16544382-fc56-44bf-bf1a-e141f65f868d admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:14.871688 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16544382-fc56-44bf-bf1a-e141f65f868d admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:14.876820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3935bd-9ea0-43bd-baea-96397e009768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:14.877685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3935bd-9ea0-43bd-baea-96397e009768 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:14.877966 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3935bd-9ea0-43bd-baea-96397e009768 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:14.878244 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3935bd-9ea0-43bd-baea-96397e009768 admin admin] PATH_INFO: `/v3/projects/0baf1a9d05bd4ee0bc309d9ceb4f9269/users/74c552b490aa4b8c843d7070b43e06af/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:14.893372 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3935bd-9ea0-43bd-baea-96397e009768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0baf1a9d05bd4ee0bc309d9ceb4f9269, user_id=74c552b490aa4b8c843d7070b43e06af, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:14.896049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3935bd-9ea0-43bd-baea-96397e009768 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:14.946721 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:14.952730 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1418/2810] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:49:14 2022] PUT /identity/v3/projects/0baf1a9d05bd4ee0bc309d9ceb4f9269/users/74c552b490aa4b8c843d7070b43e06af/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:14.956560 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdf14a-ef91-4db7-8852-8b6f305d99ad admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:14.966557 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdf14a-ef91-4db7-8852-8b6f305d99ad admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:15.022552 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abece1a-8696-4f50-bff8-1e274aafe07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:15.023223 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abece1a-8696-4f50-bff8-1e274aafe07b admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:15.023504 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abece1a-8696-4f50-bff8-1e274aafe07b admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:15.023810 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abece1a-8696-4f50-bff8-1e274aafe07b admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:15.024531 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abece1a-8696-4f50-bff8-1e274aafe07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:15.026122 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abece1a-8696-4f50-bff8-1e274aafe07b admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:15.036438 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1393/2811] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:15.040670 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3935bd-9ea0-43bd-baea-96397e009768 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:15.050907 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3935bd-9ea0-43bd-baea-96397e009768 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:15.055414 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422c35-6d56-4e99-9cb4-6f94116a2da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:15.056316 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422c35-6d56-4e99-9cb4-6f94116a2da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:15.056601 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422c35-6d56-4e99-9cb4-6f94116a2da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:15.056878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422c35-6d56-4e99-9cb4-6f94116a2da6 admin admin] PATH_INFO: `/v3/projects/0baf1a9d05bd4ee0bc309d9ceb4f9269/users/74c552b490aa4b8c843d7070b43e06af/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:15.058828 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7422c35-6d56-4e99-9cb4-6f94116a2da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0baf1a9d05bd4ee0bc309d9ceb4f9269, user_id=74c552b490aa4b8c843d7070b43e06af, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:15.062065 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7422c35-6d56-4e99-9cb4-6f94116a2da6 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:15.072047 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1419/2812] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:49:15 2022] PUT /identity/v3/projects/0baf1a9d05bd4ee0bc309d9ceb4f9269/users/74c552b490aa4b8c843d7070b43e06af/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:15.082658 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc1da1-52cb-4861-80f0-b658fc4bebd5 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:15.082893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc1da1-52cb-4861-80f0-b658fc4bebd5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:15.083172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc1da1-52cb-4861-80f0-b658fc4bebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:15.108730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-28dc1da1-52cb-4861-80f0-b658fc4bebd5 None None] MFA Rules not processed for user `74c552b490aa4b8c843d7070b43e06af`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:15.109930 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-28dc1da1-52cb-4861-80f0-b658fc4bebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:15.140732 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:15.177669 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1394/2813] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:15.188958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422c35-6d56-4e99-9cb4-6f94116a2da6 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:15.190619 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b7422c35-6d56-4e99-9cb4-6f94116a2da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:15.246482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422c35-6d56-4e99-9cb4-6f94116a2da6 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:15.250629 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0b5b-0774-4d0b-9389-e9c62e902b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:15.251260 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0b5b-0774-4d0b-9389-e9c62e902b11 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:15.251543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0b5b-0774-4d0b-9389-e9c62e902b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:15.251963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0b5b-0774-4d0b-9389-e9c62e902b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:15.260770 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0b5b-0774-4d0b-9389-e9c62e902b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:15.262200 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0b5b-0774-4d0b-9389-e9c62e902b11 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:15.271800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1420/2814] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:49:16.066008 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc1da1-52cb-4861-80f0-b658fc4bebd5 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:16.126926 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc1da1-52cb-4861-80f0-b658fc4bebd5 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:16.131397 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:16.132288 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:16.132592 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:16.132872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] PATH_INFO: `/v3/users/d308f5d205414d9bb42e4f806de0ad5b` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:16.134047 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d308f5d205414d9bb42e4f806de0ad5b)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:16.135981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:16.268048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd308f5d205414d9bb42e4f806de0ad5b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:16.268645 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd308f5d205414d9bb42e4f806de0ad5b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:16.351388 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd308f5d205414d9bb42e4f806de0ad5b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:16.358342 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd308f5d205414d9bb42e4f806de0ad5b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:16.370042 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd308f5d205414d9bb42e4f806de0ad5b'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:16.376468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1395/2815] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:49:16 2022] DELETE /identity/v3/users/d308f5d205414d9bb42e4f806de0ad5b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:16.381089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e7500-d7f3-464f-80a0-c6d0166c8a26 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:16.381566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e7500-d7f3-464f-80a0-c6d0166c8a26 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:16.381679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e7500-d7f3-464f-80a0-c6d0166c8a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:16.399905 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-408e7500-d7f3-464f-80a0-c6d0166c8a26 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:16.401096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-408e7500-d7f3-464f-80a0-c6d0166c8a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:16.457965 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1421/2816] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:16.467443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:16.468858 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:16.521262 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:16.526434 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9baea1-1fe5-417f-b8db-3444f47987f0 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:16.530180 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855918f5-6ef3-4e97-aa10-a1deacc66f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:16.530822 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855918f5-6ef3-4e97-aa10-a1deacc66f66 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:16.531105 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855918f5-6ef3-4e97-aa10-a1deacc66f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:16.531380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855918f5-6ef3-4e97-aa10-a1deacc66f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:16.540386 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855918f5-6ef3-4e97-aa10-a1deacc66f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:16.541806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855918f5-6ef3-4e97-aa10-a1deacc66f66 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:16.551244 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1396/2817] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:49:16.963049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e7500-d7f3-464f-80a0-c6d0166c8a26 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:16.966857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-408e7500-d7f3-464f-80a0-c6d0166c8a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:16.978344 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e7500-d7f3-464f-80a0-c6d0166c8a26 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:16.984175 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:16.985512 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:16.989729 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:16.989729 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] PATH_INFO: `/v3/projects/2af8675e06534f008da8b2531ca690ad` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:16.989729 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af8675e06534f008da8b2531ca690ad)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:16.989729 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:17.118469 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af8675e06534f008da8b2531ca690ad', 'request_id': 'req-db386282-e9d9-4bf3-9ae7-1a78cb723996'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.124125 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af8675e06534f008da8b2531ca690ad', 'request_id': 'req-db386282-e9d9-4bf3-9ae7-1a78cb723996'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.130425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af8675e06534f008da8b2531ca690ad', 'request_id': 'req-db386282-e9d9-4bf3-9ae7-1a78cb723996'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.208012 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] The token cache is being invalidate because project 2af8675e06534f008da8b2531ca690ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:49:17.208298 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.208913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.210425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1422/2818] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:49:16 2022] DELETE /identity/v3/projects/2af8675e06534f008da8b2531ca690ad => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:17.214440 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855918f5-6ef3-4e97-aa10-a1deacc66f66 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:17.224630 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855918f5-6ef3-4e97-aa10-a1deacc66f66 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:17.281030 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:17.281897 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:17.282182 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:17.282461 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] PATH_INFO: `/v3/users/74c552b490aa4b8c843d7070b43e06af` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:17.283635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c552b490aa4b8c843d7070b43e06af)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:17.285579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:17.483089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c552b490aa4b8c843d7070b43e06af'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.483745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c552b490aa4b8c843d7070b43e06af'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.569112 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c552b490aa4b8c843d7070b43e06af'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.576431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c552b490aa4b8c843d7070b43e06af'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.588457 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-b8053230-db27-42de-bd11-9e1ed11ffcf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c552b490aa4b8c843d7070b43e06af'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:17.594324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1397/2819] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:49:17 2022] DELETE /identity/v3/users/74c552b490aa4b8c843d7070b43e06af => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:18.022183 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:18.024032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:18.038078 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db386282-e9d9-4bf3-9ae7-1a78cb723996 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:18.049636 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:18.098496 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:18.099375 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.099652 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.099952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] PATH_INFO: `/v3/projects/0baf1a9d05bd4ee0bc309d9ceb4f9269` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.101121 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0baf1a9d05bd4ee0bc309d9ceb4f9269)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:18.103034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:18.191111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0baf1a9d05bd4ee0bc309d9ceb4f9269', 'request_id': 'req-0035af65-3bed-461a-8d93-79d2677b8a22'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:18.196586 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0baf1a9d05bd4ee0bc309d9ceb4f9269', 'request_id': 'req-0035af65-3bed-461a-8d93-79d2677b8a22'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:18.203050 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0baf1a9d05bd4ee0bc309d9ceb4f9269', 'request_id': 'req-0035af65-3bed-461a-8d93-79d2677b8a22'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:18.258927 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] The token cache is being invalidate because project 0baf1a9d05bd4ee0bc309d9ceb4f9269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:49:18.259213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:18.259867 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-0035af65-3bed-461a-8d93-79d2677b8a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:18.261385 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1423/2820] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:49:18 2022] DELETE /identity/v3/projects/0baf1a9d05bd4ee0bc309d9ceb4f9269 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:49:18.269308 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9bd2-245c-41c1-8586-13ec3a6233c0 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.269788 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9bd2-245c-41c1-8586-13ec3a6233c0 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.269891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9bd2-245c-41c1-8586-13ec3a6233c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.288623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-511f9bd2-245c-41c1-8586-13ec3a6233c0 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:18.289823 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-511f9bd2-245c-41c1-8586-13ec3a6233c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:18.349273 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1398/2821] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:18.358180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040b39-181e-48e5-87aa-8441d5cfbeb9 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.358475 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040b39-181e-48e5-87aa-8441d5cfbeb9 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.358758 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040b39-181e-48e5-87aa-8441d5cfbeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.376854 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-32040b39-181e-48e5-87aa-8441d5cfbeb9 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:18.378037 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-32040b39-181e-48e5-87aa-8441d5cfbeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:18.385724 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1424/2822] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:18.390739 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9bd2-245c-41c1-8586-13ec3a6233c0 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:18.400246 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9bd2-245c-41c1-8586-13ec3a6233c0 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:18.405444 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024709e-c280-4109-a788-14ccd5942bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:18.406078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024709e-c280-4109-a788-14ccd5942bfa admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.406360 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024709e-c280-4109-a788-14ccd5942bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.406635 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024709e-c280-4109-a788-14ccd5942bfa admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.407350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024709e-c280-4109-a788-14ccd5942bfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:49:18.407659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024709e-c280-4109-a788-14ccd5942bfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:18.409267 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024709e-c280-4109-a788-14ccd5942bfa admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:18.411523 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:18.420707 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1399/2823] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:49:18.429194 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32040b39-181e-48e5-87aa-8441d5cfbeb9 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:18.438534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32040b39-181e-48e5-87aa-8441d5cfbeb9 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:18.443221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10626c-7779-49b8-b1e0-fb5247d6ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:18.443889 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10626c-7779-49b8-b1e0-fb5247d6ac6a admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.444205 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10626c-7779-49b8-b1e0-fb5247d6ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.444482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10626c-7779-49b8-b1e0-fb5247d6ac6a admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.445155 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10626c-7779-49b8-b1e0-fb5247d6ac6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:18.447046 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10626c-7779-49b8-b1e0-fb5247d6ac6a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:18.531230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1425/2824] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:49:18 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:18.534973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024709e-c280-4109-a788-14ccd5942bfa admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:18.544923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024709e-c280-4109-a788-14ccd5942bfa admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:18.599719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d822ba-3a2d-4383-bedb-e8a20d7397ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:18.600351 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d822ba-3a2d-4383-bedb-e8a20d7397ad admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.600633 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d822ba-3a2d-4383-bedb-e8a20d7397ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.600909 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d822ba-3a2d-4383-bedb-e8a20d7397ad admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.601594 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d822ba-3a2d-4383-bedb-e8a20d7397ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:18.603514 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d822ba-3a2d-4383-bedb-e8a20d7397ad admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:18.699978 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1400/2825] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:49:18 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:18.704515 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10626c-7779-49b8-b1e0-fb5247d6ac6a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:18.715071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10626c-7779-49b8-b1e0-fb5247d6ac6a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:18.719666 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd11c6-9dc5-40b8-8d03-c9ea4fb33ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:18.720370 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd11c6-9dc5-40b8-8d03-c9ea4fb33ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.720649 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd11c6-9dc5-40b8-8d03-c9ea4fb33ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.720921 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd11c6-9dc5-40b8-8d03-c9ea4fb33ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.721662 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd11c6-9dc5-40b8-8d03-c9ea4fb33ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:18.723250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd11c6-9dc5-40b8-8d03-c9ea4fb33ac9 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:18.734599 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1426/2826] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:18.738512 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d822ba-3a2d-4383-bedb-e8a20d7397ad admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:18.748962 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d822ba-3a2d-4383-bedb-e8a20d7397ad admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:18.753634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebd304-f6af-4f06-bb5c-007a6b5a6aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:18.754282 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebd304-f6af-4f06-bb5c-007a6b5a6aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.754570 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebd304-f6af-4f06-bb5c-007a6b5a6aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.754852 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebd304-f6af-4f06-bb5c-007a6b5a6aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.755604 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebd304-f6af-4f06-bb5c-007a6b5a6aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:18.757236 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebd304-f6af-4f06-bb5c-007a6b5a6aa8 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:18.768040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1401/2827] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:18.771950 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd11c6-9dc5-40b8-8d03-c9ea4fb33ac9 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:18.781674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd11c6-9dc5-40b8-8d03-c9ea4fb33ac9 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:18.786191 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea4db8-8a68-4117-ba03-21dd55081b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:18.787042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea4db8-8a68-4117-ba03-21dd55081b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.787320 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea4db8-8a68-4117-ba03-21dd55081b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.787593 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea4db8-8a68-4117-ba03-21dd55081b28 admin admin] PATH_INFO: `/v3/projects/05ff6706146a46e6bdf844662392e735/users/690705465d1f44db8fba70cdcfd8a565/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.801985 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea4db8-8a68-4117-ba03-21dd55081b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ff6706146a46e6bdf844662392e735, user_id=690705465d1f44db8fba70cdcfd8a565, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:18.804655 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea4db8-8a68-4117-ba03-21dd55081b28 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:18.917365 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1427/2828] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:49:18 2022] PUT /identity/v3/projects/05ff6706146a46e6bdf844662392e735/users/690705465d1f44db8fba70cdcfd8a565/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:18.935569 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd3f5-6b6e-4ce0-8e54-513e19be6b1f None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:18.935902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd3f5-6b6e-4ce0-8e54-513e19be6b1f None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:18.936191 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd3f5-6b6e-4ce0-8e54-513e19be6b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:18.962651 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-eaffd3f5-6b6e-4ce0-8e54-513e19be6b1f None None] MFA Rules not processed for user `690705465d1f44db8fba70cdcfd8a565`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:18.963892 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-eaffd3f5-6b6e-4ce0-8e54-513e19be6b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:19.026118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1402/2829] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:19.031230 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea4db8-8a68-4117-ba03-21dd55081b28 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:19.071216 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:19.092224 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea4db8-8a68-4117-ba03-21dd55081b28 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:19.096940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd79179-024a-4fdd-a807-0a3744aa8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:19.104940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd79179-024a-4fdd-a807-0a3744aa8f3b admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:19.104940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd79179-024a-4fdd-a807-0a3744aa8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:19.104940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd79179-024a-4fdd-a807-0a3744aa8f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:19.104940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd79179-024a-4fdd-a807-0a3744aa8f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:19.104940 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd79179-024a-4fdd-a807-0a3744aa8f3b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:19.192598 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1428/2830] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:49:19 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:19.196663 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd3f5-6b6e-4ce0-8e54-513e19be6b1f None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:19.207655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd3f5-6b6e-4ce0-8e54-513e19be6b1f None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:19.263239 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db5069-a62d-438b-b7dd-7513c1f34cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:19.264183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db5069-a62d-438b-b7dd-7513c1f34cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:19.264468 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db5069-a62d-438b-b7dd-7513c1f34cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:19.264773 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db5069-a62d-438b-b7dd-7513c1f34cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:19.265445 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db5069-a62d-438b-b7dd-7513c1f34cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:19.267364 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db5069-a62d-438b-b7dd-7513c1f34cf5 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:19.275754 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:19.432276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1403/2831] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:49:19 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:19.436456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd79179-024a-4fdd-a807-0a3744aa8f3b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:19.446668 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd79179-024a-4fdd-a807-0a3744aa8f3b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:19.451820 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec1b60-ea76-4c1b-8258-857e7cdbc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:19.452470 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec1b60-ea76-4c1b-8258-857e7cdbc370 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:19.452752 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec1b60-ea76-4c1b-8258-857e7cdbc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:19.453030 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec1b60-ea76-4c1b-8258-857e7cdbc370 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:19.453827 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec1b60-ea76-4c1b-8258-857e7cdbc370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:19.455419 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec1b60-ea76-4c1b-8258-857e7cdbc370 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:19.465840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1429/2832] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:19.469734 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db5069-a62d-438b-b7dd-7513c1f34cf5 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:19.479501 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db5069-a62d-438b-b7dd-7513c1f34cf5 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:19.484048 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333c4d4-2670-4a56-ae32-ae820d992f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:19.484905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333c4d4-2670-4a56-ae32-ae820d992f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:19.485189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333c4d4-2670-4a56-ae32-ae820d992f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:19.485460 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333c4d4-2670-4a56-ae32-ae820d992f47 admin admin] PATH_INFO: `/v3/projects/1820c40e529c47e985ab03dd9b566050/users/bfe176712dd947e58c2c34a7df2279b7/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:19.500662 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333c4d4-2670-4a56-ae32-ae820d992f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1820c40e529c47e985ab03dd9b566050, user_id=bfe176712dd947e58c2c34a7df2279b7, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:19.503313 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333c4d4-2670-4a56-ae32-ae820d992f47 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:19.584834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1404/2833] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:49:19 2022] PUT /identity/v3/projects/1820c40e529c47e985ab03dd9b566050/users/bfe176712dd947e58c2c34a7df2279b7/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:49:19.588848 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec1b60-ea76-4c1b-8258-857e7cdbc370 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:19.598947 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec1b60-ea76-4c1b-8258-857e7cdbc370 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:19.653701 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51aaf-08ea-4a18-b5c4-846cae5d5153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:19.654357 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51aaf-08ea-4a18-b5c4-846cae5d5153 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:19.654642 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51aaf-08ea-4a18-b5c4-846cae5d5153 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:19.654918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51aaf-08ea-4a18-b5c4-846cae5d5153 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:19.655630 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f51aaf-08ea-4a18-b5c4-846cae5d5153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:19.657254 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f51aaf-08ea-4a18-b5c4-846cae5d5153 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:19.666729 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1430/2834] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:49:19.671318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333c4d4-2670-4a56-ae32-ae820d992f47 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:19.681479 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333c4d4-2670-4a56-ae32-ae820d992f47 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:19.686715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945d13-6de5-4943-90ba-294fa1434243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:19.687584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945d13-6de5-4943-90ba-294fa1434243 admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:19.687906 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945d13-6de5-4943-90ba-294fa1434243 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:19.688189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945d13-6de5-4943-90ba-294fa1434243 admin admin] PATH_INFO: `/v3/projects/1820c40e529c47e985ab03dd9b566050/users/bfe176712dd947e58c2c34a7df2279b7/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:19.690259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c945d13-6de5-4943-90ba-294fa1434243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1820c40e529c47e985ab03dd9b566050, user_id=bfe176712dd947e58c2c34a7df2279b7, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:19.692942 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c945d13-6de5-4943-90ba-294fa1434243 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:19.703226 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1405/2835] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:49:19 2022] PUT /identity/v3/projects/1820c40e529c47e985ab03dd9b566050/users/bfe176712dd947e58c2c34a7df2279b7/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:19.714451 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639761-34ef-4c49-b3e5-a293c327ffc6 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:19.718971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639761-34ef-4c49-b3e5-a293c327ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:19.718971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639761-34ef-4c49-b3e5-a293c327ffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:19.740914 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-b2639761-34ef-4c49-b3e5-a293c327ffc6 None None] MFA Rules not processed for user `bfe176712dd947e58c2c34a7df2279b7`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:19.742105 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b2639761-34ef-4c49-b3e5-a293c327ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:19.807364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1431/2836] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:49:19.819091 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945d13-6de5-4943-90ba-294fa1434243 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:19.820802 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3c945d13-6de5-4943-90ba-294fa1434243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:19.881325 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945d13-6de5-4943-90ba-294fa1434243 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:19.884952 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f70b4-366c-4298-b69a-2dad798be486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:19.885588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f70b4-366c-4298-b69a-2dad798be486 service cinder] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:19.885870 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f70b4-366c-4298-b69a-2dad798be486 service cinder] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:19.886146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f70b4-366c-4298-b69a-2dad798be486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:19.895167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f70b4-366c-4298-b69a-2dad798be486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:19.896627 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f70b4-366c-4298-b69a-2dad798be486 service cinder] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:19.906116 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1406/2837] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:49:20.117488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2639761-34ef-4c49-b3e5-a293c327ffc6 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:20.127582 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2639761-34ef-4c49-b3e5-a293c327ffc6 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:20.131102 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e288e-c111-45d5-8a85-c137cd0dbf76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:20.131739 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e288e-c111-45d5-8a85-c137cd0dbf76 service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:20.132044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e288e-c111-45d5-8a85-c137cd0dbf76 service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:20.132319 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e288e-c111-45d5-8a85-c137cd0dbf76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:20.162178 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:20.187425 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e288e-c111-45d5-8a85-c137cd0dbf76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:20.188887 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e288e-c111-45d5-8a85-c137cd0dbf76 service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:20.197795 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1432/2838] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:49:26.409857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f70b4-366c-4298-b69a-2dad798be486 service cinder] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:26.469648 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f70b4-366c-4298-b69a-2dad798be486 service cinder] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:26.474160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:26.475010 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:26.475295 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:26.475571 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] PATH_INFO: `/v3/users/690705465d1f44db8fba70cdcfd8a565` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:26.476816 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=690705465d1f44db8fba70cdcfd8a565)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:26.478730 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:26.671657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690705465d1f44db8fba70cdcfd8a565'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:26.672271 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690705465d1f44db8fba70cdcfd8a565'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:26.751285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690705465d1f44db8fba70cdcfd8a565'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:26.756831 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:26.758816 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690705465d1f44db8fba70cdcfd8a565'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:26.770958 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690705465d1f44db8fba70cdcfd8a565'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:26.776750 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1407/2839] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:49:26 2022] DELETE /identity/v3/users/690705465d1f44db8fba70cdcfd8a565 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:26.782028 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511a60f-dda4-40aa-be80-7ba0597286b5 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:26.786733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511a60f-dda4-40aa-be80-7ba0597286b5 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:26.786733 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511a60f-dda4-40aa-be80-7ba0597286b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:26.800226 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-4511a60f-dda4-40aa-be80-7ba0597286b5 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:26.801422 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4511a60f-dda4-40aa-be80-7ba0597286b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:26.860162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1433/2840] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:26.869860 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:26.872623 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:26.930419 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9588a-e8dc-4b06-ac06-b6ba85e2c31a admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:26.933999 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a096a-8b78-4480-8dc9-73ca73f661f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:26.934639 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a096a-8b78-4480-8dc9-73ca73f661f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:26.934923 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a096a-8b78-4480-8dc9-73ca73f661f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:26.935202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a096a-8b78-4480-8dc9-73ca73f661f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:26.944141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a096a-8b78-4480-8dc9-73ca73f661f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:26.945556 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a096a-8b78-4480-8dc9-73ca73f661f6 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:26.954885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1408/2841] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:49:27.369951 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511a60f-dda4-40aa-be80-7ba0597286b5 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:27.372803 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4511a60f-dda4-40aa-be80-7ba0597286b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:27.386124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511a60f-dda4-40aa-be80-7ba0597286b5 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:27.390973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:27.391896 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:27.392774 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:27.393210 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] PATH_INFO: `/v3/projects/05ff6706146a46e6bdf844662392e735` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:27.394510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ff6706146a46e6bdf844662392e735)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:27.396404 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:27.494602 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ff6706146a46e6bdf844662392e735', 'request_id': 'req-7d5ea04f-416f-461e-929f-2fb6639765f1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.500657 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ff6706146a46e6bdf844662392e735', 'request_id': 'req-7d5ea04f-416f-461e-929f-2fb6639765f1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.506679 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ff6706146a46e6bdf844662392e735', 'request_id': 'req-7d5ea04f-416f-461e-929f-2fb6639765f1'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.601959 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] The token cache is being invalidate because project 05ff6706146a46e6bdf844662392e735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:49:27.602252 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.602874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.604460 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1434/2842] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:49:27 2022] DELETE /identity/v3/projects/05ff6706146a46e6bdf844662392e735 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:27.608467 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a096a-8b78-4480-8dc9-73ca73f661f6 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:27.617977 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a096a-8b78-4480-8dc9-73ca73f661f6 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:27.672964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:27.673821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:27.674102 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:27.674379 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] PATH_INFO: `/v3/users/bfe176712dd947e58c2c34a7df2279b7` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:27.675550 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe176712dd947e58c2c34a7df2279b7)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:27.677515 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:27.855774 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe176712dd947e58c2c34a7df2279b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.856428 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe176712dd947e58c2c34a7df2279b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.940380 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe176712dd947e58c2c34a7df2279b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.947644 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe176712dd947e58c2c34a7df2279b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.959697 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-f7ae148b-23cb-46c8-9171-c13df781c9d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe176712dd947e58c2c34a7df2279b7'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:27.961888 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:27.966159 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1409/2843] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:49:27 2022] DELETE /identity/v3/users/bfe176712dd947e58c2c34a7df2279b7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:28.359505 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:28.361868 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:28.375669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea04f-416f-461e-929f-2fb6639765f1 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:28.427578 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:28.434220 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:28.437082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:28.437082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:28.437082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] PATH_INFO: `/v3/projects/1820c40e529c47e985ab03dd9b566050` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:28.437082 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1820c40e529c47e985ab03dd9b566050)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:28.438822 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:28.551612 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1820c40e529c47e985ab03dd9b566050', 'request_id': 'req-6214c3f9-44f7-473c-9663-e3a4ec171ec4'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:28.557177 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1820c40e529c47e985ab03dd9b566050', 'request_id': 'req-6214c3f9-44f7-473c-9663-e3a4ec171ec4'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:28.563345 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1820c40e529c47e985ab03dd9b566050', 'request_id': 'req-6214c3f9-44f7-473c-9663-e3a4ec171ec4'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:28.659145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] The token cache is being invalidate because project 1820c40e529c47e985ab03dd9b566050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:49:28.659426 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:28.660084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-6214c3f9-44f7-473c-9663-e3a4ec171ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:28.661592 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1435/2844] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:49:28 2022] DELETE /identity/v3/projects/1820c40e529c47e985ab03dd9b566050 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:28.667183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e39d-91d1-406b-8827-3c5d3d8cb6df None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:28.667654 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e39d-91d1-406b-8827-3c5d3d8cb6df None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:28.667811 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e39d-91d1-406b-8827-3c5d3d8cb6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:28.686257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-f295e39d-91d1-406b-8827-3c5d3d8cb6df None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:28.687442 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-f295e39d-91d1-406b-8827-3c5d3d8cb6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:28.745834 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1410/2845] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:28.753967 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7bd10-addf-4bf8-8fbe-280409b11372 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:28.754267 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7bd10-addf-4bf8-8fbe-280409b11372 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:28.754551 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7bd10-addf-4bf8-8fbe-280409b11372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:28.774353 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-eea7bd10-addf-4bf8-8fbe-280409b11372 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:28.775552 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-eea7bd10-addf-4bf8-8fbe-280409b11372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:28.783995 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1436/2846] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:28.787944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e39d-91d1-406b-8827-3c5d3d8cb6df None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:28.797671 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e39d-91d1-406b-8827-3c5d3d8cb6df None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:28.802318 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6c6a-90b0-4d9f-9b01-f076428dc5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:28.802963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6c6a-90b0-4d9f-9b01-f076428dc5af admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:28.803248 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6c6a-90b0-4d9f-9b01-f076428dc5af admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:28.803527 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6c6a-90b0-4d9f-9b01-f076428dc5af admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:28.804306 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d6c6a-90b0-4d9f-9b01-f076428dc5af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:49:28.804614 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d6c6a-90b0-4d9f-9b01-f076428dc5af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:28.806201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d6c6a-90b0-4d9f-9b01-f076428dc5af admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:28.817555 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1411/2847] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:49:28.821516 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7bd10-addf-4bf8-8fbe-280409b11372 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:28.831193 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7bd10-addf-4bf8-8fbe-280409b11372 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:28.835767 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555b4c9-df60-4184-b598-4bd47a94eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:28.836417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555b4c9-df60-4184-b598-4bd47a94eaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:28.836695 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555b4c9-df60-4184-b598-4bd47a94eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:28.836968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555b4c9-df60-4184-b598-4bd47a94eaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:28.837669 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555b4c9-df60-4184-b598-4bd47a94eaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:28.839534 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555b4c9-df60-4184-b598-4bd47a94eaa5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:28.947209 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1437/2848] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:49:28 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:28.951320 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6c6a-90b0-4d9f-9b01-f076428dc5af admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:28.961297 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d6c6a-90b0-4d9f-9b01-f076428dc5af admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:29.016872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2ec03-1421-46a2-b1c3-225840b08c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:29.017533 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2ec03-1421-46a2-b1c3-225840b08c15 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:29.017821 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2ec03-1421-46a2-b1c3-225840b08c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:29.018100 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2ec03-1421-46a2-b1c3-225840b08c15 admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:29.018775 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2ec03-1421-46a2-b1c3-225840b08c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:29.020725 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2ec03-1421-46a2-b1c3-225840b08c15 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:29.158405 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1412/2849] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:49:28 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:29.162417 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555b4c9-df60-4184-b598-4bd47a94eaa5 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:29.173326 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555b4c9-df60-4184-b598-4bd47a94eaa5 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:29.178051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b6d32-687a-49a0-b8ad-041cda7d0a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:29.178704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b6d32-687a-49a0-b8ad-041cda7d0a2a admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:29.178980 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b6d32-687a-49a0-b8ad-041cda7d0a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:29.179251 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b6d32-687a-49a0-b8ad-041cda7d0a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:29.180032 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b6d32-687a-49a0-b8ad-041cda7d0a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:29.181613 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b6d32-687a-49a0-b8ad-041cda7d0a2a admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:29.191781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1438/2850] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:29.195634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2ec03-1421-46a2-b1c3-225840b08c15 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:29.205559 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2ec03-1421-46a2-b1c3-225840b08c15 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:29.210079 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce58e9c-0a81-4871-ad65-dac0f45d6a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:29.210783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce58e9c-0a81-4871-ad65-dac0f45d6a81 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:29.211074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce58e9c-0a81-4871-ad65-dac0f45d6a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:29.211357 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce58e9c-0a81-4871-ad65-dac0f45d6a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:29.212107 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce58e9c-0a81-4871-ad65-dac0f45d6a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:29.213701 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce58e9c-0a81-4871-ad65-dac0f45d6a81 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:29.224381 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1413/2851] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:29.228180 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b6d32-687a-49a0-b8ad-041cda7d0a2a admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:29.238342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b6d32-687a-49a0-b8ad-041cda7d0a2a admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:29.242727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13515fdb-429a-49a7-ac4f-41a5169b749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:29.243574 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13515fdb-429a-49a7-ac4f-41a5169b749e admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:29.243898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13515fdb-429a-49a7-ac4f-41a5169b749e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:29.244171 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13515fdb-429a-49a7-ac4f-41a5169b749e admin admin] PATH_INFO: `/v3/projects/5adbfc394c314435a81e9cfc01161171/users/69ff9d4d5b29445bb03cf4126935c510/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:29.257971 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13515fdb-429a-49a7-ac4f-41a5169b749e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adbfc394c314435a81e9cfc01161171, user_id=69ff9d4d5b29445bb03cf4126935c510, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:29.260649 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13515fdb-429a-49a7-ac4f-41a5169b749e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:29.366663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1439/2852] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:49:29 2022] PUT /identity/v3/projects/5adbfc394c314435a81e9cfc01161171/users/69ff9d4d5b29445bb03cf4126935c510/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:29.376881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600f22-2c61-475c-8e37-65d880eac5ac None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:29.379848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600f22-2c61-475c-8e37-65d880eac5ac None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:29.379848 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600f22-2c61-475c-8e37-65d880eac5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:29.404465 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-5d600f22-2c61-475c-8e37-65d880eac5ac None None] MFA Rules not processed for user `69ff9d4d5b29445bb03cf4126935c510`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:29.405692 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-5d600f22-2c61-475c-8e37-65d880eac5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:29.460854 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:29.469842 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1414/2853] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:29.481537 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13515fdb-429a-49a7-ac4f-41a5169b749e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:29.483274 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-13515fdb-429a-49a7-ac4f-41a5169b749e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:29.540575 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13515fdb-429a-49a7-ac4f-41a5169b749e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:29.544228 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a605dea-8a81-4531-be1b-8c1541652264 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24198f20ebcd4e64a5184fb9fc6764cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:29.544863 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a605dea-8a81-4531-be1b-8c1541652264 service glance] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:29.545148 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a605dea-8a81-4531-be1b-8c1541652264 service glance] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:29.545424 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a605dea-8a81-4531-be1b-8c1541652264 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:29.553692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a605dea-8a81-4531-be1b-8c1541652264 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:29.555135 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a605dea-8a81-4531-be1b-8c1541652264 service glance] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:29.564061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1440/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:49:39.528862 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:39.559932 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:52.499499 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d600f22-2c61-475c-8e37-65d880eac5ac None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:52.558922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d600f22-2c61-475c-8e37-65d880eac5ac None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:52.564069 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:52.569803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:52.569803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:52.569803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] PATH_INFO: `/v3/users/69ff9d4d5b29445bb03cf4126935c510` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:52.569803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ff9d4d5b29445bb03cf4126935c510)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:52.569803 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:52.764118 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ff9d4d5b29445bb03cf4126935c510'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:52.764719 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ff9d4d5b29445bb03cf4126935c510'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:52.813588 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ff9d4d5b29445bb03cf4126935c510'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:52.820553 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ff9d4d5b29445bb03cf4126935c510'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:52.832310 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ff9d4d5b29445bb03cf4126935c510'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:52.838327 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1415/2855] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:49:52 2022] DELETE /identity/v3/users/69ff9d4d5b29445bb03cf4126935c510 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:52.843456 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363cdc4-9e64-4502-b009-1821140cb34a None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:52.848797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363cdc4-9e64-4502-b009-1821140cb34a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:52.848797 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363cdc4-9e64-4502-b009-1821140cb34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:52.861381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-e363cdc4-9e64-4502-b009-1821140cb34a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:52.862549 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e363cdc4-9e64-4502-b009-1821140cb34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:52.919250 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1441/2856] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:52.929526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:52.930919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:52.988655 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a349e-00db-4a68-9678-fd219f4b603e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:52.992256 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5380eb4-1006-48e4-b239-84f1b2cceeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:52.992885 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5380eb4-1006-48e4-b239-84f1b2cceeae service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:52.993167 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5380eb4-1006-48e4-b239-84f1b2cceeae service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:52.993439 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5380eb4-1006-48e4-b239-84f1b2cceeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:53.002277 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5380eb4-1006-48e4-b239-84f1b2cceeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:53.003688 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5380eb4-1006-48e4-b239-84f1b2cceeae service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:53.013015 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1416/2857] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:49:53.418992 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363cdc4-9e64-4502-b009-1821140cb34a None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:53.420969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-e363cdc4-9e64-4502-b009-1821140cb34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:53.433983 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363cdc4-9e64-4502-b009-1821140cb34a None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:53.439362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:53.441312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:53.441312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:53.441312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] PATH_INFO: `/v3/projects/5adbfc394c314435a81e9cfc01161171` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:53.442888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adbfc394c314435a81e9cfc01161171)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:53.445021 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:53.567908 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adbfc394c314435a81e9cfc01161171', 'request_id': 'req-109dc691-80ce-4736-8ff1-7793ef271c44'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:53.573482 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adbfc394c314435a81e9cfc01161171', 'request_id': 'req-109dc691-80ce-4736-8ff1-7793ef271c44'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:53.579560 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adbfc394c314435a81e9cfc01161171', 'request_id': 'req-109dc691-80ce-4736-8ff1-7793ef271c44'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:53.696772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] The token cache is being invalidate because project 5adbfc394c314435a81e9cfc01161171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:49:53.697059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:53.697685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-109dc691-80ce-4736-8ff1-7793ef271c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:49:53.699211 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1442/2858] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:49:53 2022] DELETE /identity/v3/projects/5adbfc394c314435a81e9cfc01161171 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:53.704257 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f94b69-edac-4fa8-8511-a4853770c37e None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:53.705981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f94b69-edac-4fa8-8511-a4853770c37e None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:53.705981 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f94b69-edac-4fa8-8511-a4853770c37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:53.722741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-73f94b69-edac-4fa8-8511-a4853770c37e None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:53.723991 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-73f94b69-edac-4fa8-8511-a4853770c37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:53.741285 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:53.782224 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1417/2859] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:53.791044 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00a06d-ba08-4456-bb6f-c27856262f0c None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:53.791328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00a06d-ba08-4456-bb6f-c27856262f0c None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:53.791604 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00a06d-ba08-4456-bb6f-c27856262f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:53.810107 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-7c00a06d-ba08-4456-bb6f-c27856262f0c None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:53.811327 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7c00a06d-ba08-4456-bb6f-c27856262f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:53.819157 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1443/2860] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:53.823324 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f94b69-edac-4fa8-8511-a4853770c37e None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:53.833429 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f94b69-edac-4fa8-8511-a4853770c37e None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:53.838040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8570f4-2dbb-44cd-be66-da6ff5c7ad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:53.838679 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8570f4-2dbb-44cd-be66-da6ff5c7ad26 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:53.838960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8570f4-2dbb-44cd-be66-da6ff5c7ad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:53.839234 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8570f4-2dbb-44cd-be66-da6ff5c7ad26 admin admin] PATH_INFO: `/v3/domains` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:53.839975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8570f4-2dbb-44cd-be66-da6ff5c7ad26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:49:53.840283 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8570f4-2dbb-44cd-be66-da6ff5c7ad26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:53.841973 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8570f4-2dbb-44cd-be66-da6ff5c7ad26 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:53.853347 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1418/2861] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:49:53.857878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00a06d-ba08-4456-bb6f-c27856262f0c None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:53.866918 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00a06d-ba08-4456-bb6f-c27856262f0c None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:53.871541 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea80982-66f8-4a42-b932-46b3716ef563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:53.872217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea80982-66f8-4a42-b932-46b3716ef563 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:53.872499 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea80982-66f8-4a42-b932-46b3716ef563 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:53.872772 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea80982-66f8-4a42-b932-46b3716ef563 admin admin] PATH_INFO: `/v3/projects` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:53.874061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea80982-66f8-4a42-b932-46b3716ef563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:53.876045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea80982-66f8-4a42-b932-46b3716ef563 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:53.985094 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1444/2862] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:49:53 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:49:53.989206 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8570f4-2dbb-44cd-be66-da6ff5c7ad26 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:53.999450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8570f4-2dbb-44cd-be66-da6ff5c7ad26 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:54.053860 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944184f-0013-472f-a2ce-52bcc2cf252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:54.054524 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944184f-0013-472f-a2ce-52bcc2cf252e admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:54.054806 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944184f-0013-472f-a2ce-52bcc2cf252e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:54.055082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944184f-0013-472f-a2ce-52bcc2cf252e admin admin] PATH_INFO: `/v3/users` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:54.055798 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944184f-0013-472f-a2ce-52bcc2cf252e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:54.057706 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944184f-0013-472f-a2ce-52bcc2cf252e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:54.162488 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1419/2863] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:49:53 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:49:54.166594 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea80982-66f8-4a42-b932-46b3716ef563 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:54.177539 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea80982-66f8-4a42-b932-46b3716ef563 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:54.182122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc34e3-3517-4e1b-a97e-fbac86c2c4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:54.182776 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc34e3-3517-4e1b-a97e-fbac86c2c4dd admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:54.183061 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc34e3-3517-4e1b-a97e-fbac86c2c4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:54.183342 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc34e3-3517-4e1b-a97e-fbac86c2c4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:54.184132 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc34e3-3517-4e1b-a97e-fbac86c2c4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:54.186406 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc34e3-3517-4e1b-a97e-fbac86c2c4dd admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:54.196704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1445/2864] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:54.200433 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944184f-0013-472f-a2ce-52bcc2cf252e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:54.210171 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944184f-0013-472f-a2ce-52bcc2cf252e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:54.214912 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da12ce-41d3-4802-9157-77998e975b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:54.215562 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da12ce-41d3-4802-9157-77998e975b4f admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:54.215890 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da12ce-41d3-4802-9157-77998e975b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:54.216172 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da12ce-41d3-4802-9157-77998e975b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:54.217377 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da12ce-41d3-4802-9157-77998e975b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:54.219202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da12ce-41d3-4802-9157-77998e975b4f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:54.230068 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1420/2865] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:49:54.234750 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc34e3-3517-4e1b-a97e-fbac86c2c4dd admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:54.244639 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc34e3-3517-4e1b-a97e-fbac86c2c4dd admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:54.249242 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e583d-2faa-46fb-b599-dd015221a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:54.250124 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e583d-2faa-46fb-b599-dd015221a275 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:54.250412 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e583d-2faa-46fb-b599-dd015221a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:54.250693 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e583d-2faa-46fb-b599-dd015221a275 admin admin] PATH_INFO: `/v3/projects/c890d2a7b12248a18e65ccfe6f07fb19/users/6ea26de9328a445981fbbea9b086a539/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:54.265909 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e583d-2faa-46fb-b599-dd015221a275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c890d2a7b12248a18e65ccfe6f07fb19, user_id=6ea26de9328a445981fbbea9b086a539, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:54.268615 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e583d-2faa-46fb-b599-dd015221a275 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:54.339000 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1446/2866] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:49:54 2022] PUT /identity/v3/projects/c890d2a7b12248a18e65ccfe6f07fb19/users/6ea26de9328a445981fbbea9b086a539/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:49:54.349850 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad965a0-b649-450c-a24f-59f369ad7e99 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:54.350152 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad965a0-b649-450c-a24f-59f369ad7e99 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:54.350435 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad965a0-b649-450c-a24f-59f369ad7e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:54.377094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-1ad965a0-b649-450c-a24f-59f369ad7e99 None None] MFA Rules not processed for user `6ea26de9328a445981fbbea9b086a539`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:49:54.378362 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1ad965a0-b649-450c-a24f-59f369ad7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:54.441078 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1421/2867] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:49:54.451561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e583d-2faa-46fb-b599-dd015221a275 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:49:54.453264 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-0e5e583d-2faa-46fb-b599-dd015221a275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:49:54.475036 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:54.509106 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e583d-2faa-46fb-b599-dd015221a275 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:49:54.512747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5fe3-c26d-4f34-b5e6-36794220efde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7973be0cfa9846afaef91c7ae1b190d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:49:54.513392 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5fe3-c26d-4f34-b5e6-36794220efde service cinder] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:49:54.513958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5fe3-c26d-4f34-b5e6-36794220efde service cinder] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:49:54.514241 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5fe3-c26d-4f34-b5e6-36794220efde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:49:54.523402 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c5fe3-c26d-4f34-b5e6-36794220efde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:49:54.524882 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c5fe3-c26d-4f34-b5e6-36794220efde service cinder] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:49:54.537811 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1447/2868] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:49:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:50:04.438121 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:04.596542 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=17 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:04.705520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad965a0-b649-450c-a24f-59f369ad7e99 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:04.707186 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1ad965a0-b649-450c-a24f-59f369ad7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:04.762481 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad965a0-b649-450c-a24f-59f369ad7e99 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:04.766916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:04.767554 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:04.767872 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:04.768147 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:04.769895 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:04.840684 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:04.842657 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:04.854208 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1422/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:50:05.878954 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5fe3-c26d-4f34-b5e6-36794220efde service cinder] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:05.943391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5fe3-c26d-4f34-b5e6-36794220efde service cinder] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:05.948089 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:05.948984 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:05.949278 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:05.949562 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] PATH_INFO: `/v3/users/6ea26de9328a445981fbbea9b086a539` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:05.950892 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea26de9328a445981fbbea9b086a539)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:05.953202 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:06.023478 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:06.025189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:06.036905 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d8fb1-07fc-4675-9762-46c340c3b0a4 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:06.041889 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef3051-678c-4923-835e-98d94b41636a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:06.044089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3051-678c-4923-835e-98d94b41636a service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:06.044089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3051-678c-4923-835e-98d94b41636a service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:06.044089 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3051-678c-4923-835e-98d94b41636a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:06.046063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-30ef3051-678c-4923-835e-98d94b41636a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:06.060202 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef3051-678c-4923-835e-98d94b41636a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:06.061964 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef3051-678c-4923-835e-98d94b41636a service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:06.074044 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1423/2870] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:50:06.128034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea26de9328a445981fbbea9b086a539'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:06.128690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea26de9328a445981fbbea9b086a539'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:06.139519 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea26de9328a445981fbbea9b086a539'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:06.230321 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea26de9328a445981fbbea9b086a539'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:06.245068 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea26de9328a445981fbbea9b086a539'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:06.251823 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1448/2871] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:50:05 2022] DELETE /identity/v3/users/6ea26de9328a445981fbbea9b086a539 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:50:06.256294 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435501b7-960c-42cc-8cbb-f25e0ab3be30 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:06.256590 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435501b7-960c-42cc-8cbb-f25e0ab3be30 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:06.259531 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435501b7-960c-42cc-8cbb-f25e0ab3be30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:06.274674 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-435501b7-960c-42cc-8cbb-f25e0ab3be30 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:50:06.275921 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-435501b7-960c-42cc-8cbb-f25e0ab3be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:06.333020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1424/2872] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:50:06.342644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:06.344088 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:06.401883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b568a-a003-4c49-9ae8-b5451cc03707 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:06.405507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab28f2-2a1f-4006-a7f5-8db24fb1af8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:06.406146 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab28f2-2a1f-4006-a7f5-8db24fb1af8d service neutron] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:06.406432 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab28f2-2a1f-4006-a7f5-8db24fb1af8d service neutron] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:06.406710 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab28f2-2a1f-4006-a7f5-8db24fb1af8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:06.415488 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab28f2-2a1f-4006-a7f5-8db24fb1af8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:06.416973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab28f2-2a1f-4006-a7f5-8db24fb1af8d service neutron] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:06.426217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1449/2873] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:50:06.835189 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435501b7-960c-42cc-8cbb-f25e0ab3be30 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:06.836792 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-435501b7-960c-42cc-8cbb-f25e0ab3be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:06.849265 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435501b7-960c-42cc-8cbb-f25e0ab3be30 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:06.854055 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:06.854925 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:06.855207 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:06.855485 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] PATH_INFO: `/v3/projects/c890d2a7b12248a18e65ccfe6f07fb19` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:06.856715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c890d2a7b12248a18e65ccfe6f07fb19)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:06.858646 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:06.884902 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:06.956758 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c890d2a7b12248a18e65ccfe6f07fb19', 'request_id': 'req-5d9e733e-9a4c-43b5-b833-f8658290f441'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:06.963064 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c890d2a7b12248a18e65ccfe6f07fb19', 'request_id': 'req-5d9e733e-9a4c-43b5-b833-f8658290f441'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:07.007660 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c890d2a7b12248a18e65ccfe6f07fb19', 'request_id': 'req-5d9e733e-9a4c-43b5-b833-f8658290f441'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:07.019857 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] The token cache is being invalidate because project c890d2a7b12248a18e65ccfe6f07fb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:50:07.020609 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:07.021577 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-5d9e733e-9a4c-43b5-b833-f8658290f441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:50:07.026853 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1425/2874] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:50:06 2022] DELETE /identity/v3/projects/c890d2a7b12248a18e65ccfe6f07fb19 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:50:07.029493 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989191e-4a5e-4326-9f23-6803d0dfe111 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.029898 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989191e-4a5e-4326-9f23-6803d0dfe111 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.030073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989191e-4a5e-4326-9f23-6803d0dfe111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.049472 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-5989191e-4a5e-4326-9f23-6803d0dfe111 None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:50:07.050717 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-5989191e-4a5e-4326-9f23-6803d0dfe111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:07.068760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:07.113042 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1450/2875] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:50:07.121768 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e1af-c1d6-4589-8c5e-f22eea0143dd None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.122415 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e1af-c1d6-4589-8c5e-f22eea0143dd None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.122881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e1af-c1d6-4589-8c5e-f22eea0143dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.141743 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-ab00e1af-c1d6-4589-8c5e-f22eea0143dd None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:50:07.142948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-ab00e1af-c1d6-4589-8c5e-f22eea0143dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:07.151194 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1426/2876] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:50:07.155997 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989191e-4a5e-4326-9f23-6803d0dfe111 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:07.165969 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989191e-4a5e-4326-9f23-6803d0dfe111 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:07.171130 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551981ef-20db-47d5-bfe2-85c517291537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:07.171806 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551981ef-20db-47d5-bfe2-85c517291537 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.172096 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551981ef-20db-47d5-bfe2-85c517291537 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.172371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551981ef-20db-47d5-bfe2-85c517291537 admin admin] PATH_INFO: `/v3/domains` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.173217 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551981ef-20db-47d5-bfe2-85c517291537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:50:07.173532 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551981ef-20db-47d5-bfe2-85c517291537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:07.175145 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551981ef-20db-47d5-bfe2-85c517291537 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:07.186897 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1451/2877] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 16 00:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:50:07.191020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e1af-c1d6-4589-8c5e-f22eea0143dd None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:07.200448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e1af-c1d6-4589-8c5e-f22eea0143dd None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:07.205374 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc508-a3e8-42f5-a4bb-13c00a83dc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:07.205984 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc508-a3e8-42f5-a4bb-13c00a83dc3f admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.206267 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc508-a3e8-42f5-a4bb-13c00a83dc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.206911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc508-a3e8-42f5-a4bb-13c00a83dc3f admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.207593 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc508-a3e8-42f5-a4bb-13c00a83dc3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:07.209259 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc508-a3e8-42f5-a4bb-13c00a83dc3f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:07.320005 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1427/2878] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:50:07 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:50:07.322732 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551981ef-20db-47d5-bfe2-85c517291537 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:07.333503 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551981ef-20db-47d5-bfe2-85c517291537 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:07.394926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421703b4-9118-43c0-997c-1d306796cf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:07.395500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421703b4-9118-43c0-997c-1d306796cf32 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.395916 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421703b4-9118-43c0-997c-1d306796cf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.396193 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421703b4-9118-43c0-997c-1d306796cf32 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.396874 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421703b4-9118-43c0-997c-1d306796cf32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:07.398792 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421703b4-9118-43c0-997c-1d306796cf32 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:07.470522 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1452/2879] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:50:07 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:50:07.474507 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc508-a3e8-42f5-a4bb-13c00a83dc3f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:07.485454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc508-a3e8-42f5-a4bb-13c00a83dc3f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:07.490173 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126957-84b6-4341-afe9-b604e93c1747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:07.490828 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126957-84b6-4341-afe9-b604e93c1747 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.491113 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126957-84b6-4341-afe9-b604e93c1747 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.491392 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126957-84b6-4341-afe9-b604e93c1747 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.492222 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31126957-84b6-4341-afe9-b604e93c1747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:07.493814 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31126957-84b6-4341-afe9-b604e93c1747 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:07.504771 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1428/2880] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:50:07.508504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421703b4-9118-43c0-997c-1d306796cf32 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:07.518510 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421703b4-9118-43c0-997c-1d306796cf32 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:07.522973 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05107b5-501e-42e0-aa21-6db931373539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:07.523610 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05107b5-501e-42e0-aa21-6db931373539 admin admin] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.523935 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05107b5-501e-42e0-aa21-6db931373539 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.524212 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05107b5-501e-42e0-aa21-6db931373539 admin admin] PATH_INFO: `/v3/roles` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.524915 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05107b5-501e-42e0-aa21-6db931373539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:07.526495 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05107b5-501e-42e0-aa21-6db931373539 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:07.536201 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1453/2881] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:50:07.540074 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126957-84b6-4341-afe9-b604e93c1747 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:07.550087 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126957-84b6-4341-afe9-b604e93c1747 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:07.554568 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64254734-69ce-4e40-968d-5dfa7d9fb05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:07.555423 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64254734-69ce-4e40-968d-5dfa7d9fb05f admin admin] REQUEST_METHOD: `PUT` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.555703 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64254734-69ce-4e40-968d-5dfa7d9fb05f admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.556000 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64254734-69ce-4e40-968d-5dfa7d9fb05f admin admin] PATH_INFO: `/v3/projects/e5e40c7d9b3145c4af0a03e0581e5fb3/users/85172422aa1844edb85eee1a6072291f/roles/83fe8b5fb84b42b298cd6be18a2d0759` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.571138 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64254734-69ce-4e40-968d-5dfa7d9fb05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e40c7d9b3145c4af0a03e0581e5fb3, user_id=85172422aa1844edb85eee1a6072291f, role_id=83fe8b5fb84b42b298cd6be18a2d0759)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:07.573839 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64254734-69ce-4e40-968d-5dfa7d9fb05f admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:07.657418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1429/2882] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:50:07 2022] PUT /identity/v3/projects/e5e40c7d9b3145c4af0a03e0581e5fb3/users/85172422aa1844edb85eee1a6072291f/roles/83fe8b5fb84b42b298cd6be18a2d0759 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:50:07.662413 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8a1e7-f47c-4b0f-8fe6-118b1b9d797a None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.662715 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8a1e7-f47c-4b0f-8fe6-118b1b9d797a None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.663004 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8a1e7-f47c-4b0f-8fe6-118b1b9d797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.681111 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-98b8a1e7-f47c-4b0f-8fe6-118b1b9d797a None None] MFA Rules not processed for user `b772abf551ba4a3bbcb1567e3ad5b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:50:07.682318 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-98b8a1e7-f47c-4b0f-8fe6-118b1b9d797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:07.741007 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1454/2883] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:50:07.750937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64254734-69ce-4e40-968d-5dfa7d9fb05f admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:07.752636 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-64254734-69ce-4e40-968d-5dfa7d9fb05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:07.810063 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64254734-69ce-4e40-968d-5dfa7d9fb05f admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:07.813756 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03476-a9a1-4bfa-b947-fd85499848f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:07.814418 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03476-a9a1-4bfa-b947-fd85499848f3 service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:07.814702 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03476-a9a1-4bfa-b947-fd85499848f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:07.815003 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03476-a9a1-4bfa-b947-fd85499848f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:07.823833 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a03476-a9a1-4bfa-b947-fd85499848f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:07.825255 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a03476-a9a1-4bfa-b947-fd85499848f3 service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:07.834469 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1430/2884] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:50:14.042893 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971e5f-2570-4b55-8442-94612eae7660 None None] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:14.043351 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971e5f-2570-4b55-8442-94612eae7660 None None] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:14.043783 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971e5f-2570-4b55-8442-94612eae7660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:14.078581 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.auth.core [None req-64971e5f-2570-4b55-8442-94612eae7660 None None] MFA Rules not processed for user `85172422aa1844edb85eee1a6072291f`. Rule list: `[]` (Enabled: `True`). {{(pid=97110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:50:14.080101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-64971e5f-2570-4b55-8442-94612eae7660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:14.099644 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:14.149709 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1455/2885] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:50:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:50:14.154169 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03476-a9a1-4bfa-b947-fd85499848f3 service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:14.163813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03476-a9a1-4bfa-b947-fd85499848f3 service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:14.168359 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90ed5-2c65-469b-ae29-87d046fca2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:14.168995 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90ed5-2c65-469b-ae29-87d046fca2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:14.169276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90ed5-2c65-469b-ae29-87d046fca2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:14.169549 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90ed5-2c65-469b-ae29-87d046fca2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:14.170755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90ed5-2c65-469b-ae29-87d046fca2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:14.172675 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90ed5-2c65-469b-ae29-87d046fca2f3 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:14.269781 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1431/2886] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 16 00:50:14 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:50:14.272876 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64971e5f-2570-4b55-8442-94612eae7660 None None] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:14.285719 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64971e5f-2570-4b55-8442-94612eae7660 None None] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:14.349711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97014848-64a9-4ccf-88f2-eed4f842d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:14.350374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97014848-64a9-4ccf-88f2-eed4f842d6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:14.350658 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97014848-64a9-4ccf-88f2-eed4f842d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:14.350931 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97014848-64a9-4ccf-88f2-eed4f842d6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:14.351637 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97014848-64a9-4ccf-88f2-eed4f842d6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:14.353589 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97014848-64a9-4ccf-88f2-eed4f842d6e5 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:14.457956 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1456/2887] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 16 00:50:14 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:50:14.462020 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90ed5-2c65-469b-ae29-87d046fca2f3 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:14.472777 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90ed5-2c65-469b-ae29-87d046fca2f3 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:14.477243 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0aefb-e9b3-4b61-85c7-8df5281c7a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:14.477891 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0aefb-e9b3-4b61-85c7-8df5281c7a78 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:14.478287 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0aefb-e9b3-4b61-85c7-8df5281c7a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:14.478575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0aefb-e9b3-4b61-85c7-8df5281c7a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:14.483951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0aefb-e9b3-4b61-85c7-8df5281c7a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:14.485579 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0aefb-e9b3-4b61-85c7-8df5281c7a78 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:14.497417 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1432/2888] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:50:14.501391 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97014848-64a9-4ccf-88f2-eed4f842d6e5 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:14.513277 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97014848-64a9-4ccf-88f2-eed4f842d6e5 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:14.518086 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd43a6d-0659-4b78-85ed-1ddb3054ff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:14.518963 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43a6d-0659-4b78-85ed-1ddb3054ff14 admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:14.519930 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43a6d-0659-4b78-85ed-1ddb3054ff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:14.520213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43a6d-0659-4b78-85ed-1ddb3054ff14 admin admin] PATH_INFO: `/v3/projects/5581b4bf5c2844559d61b1ef4c445b33/users/dfef5f0bed7143f08f300112ead254ee/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:14.536328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd43a6d-0659-4b78-85ed-1ddb3054ff14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5581b4bf5c2844559d61b1ef4c445b33, user_id=dfef5f0bed7143f08f300112ead254ee, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:14.539023 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd43a6d-0659-4b78-85ed-1ddb3054ff14 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:14.618051 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1457/2889] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:50:14 2022] PUT /identity/v3/projects/5581b4bf5c2844559d61b1ef4c445b33/users/dfef5f0bed7143f08f300112ead254ee/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:50:14.619443 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0aefb-e9b3-4b61-85c7-8df5281c7a78 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:14.632339 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0aefb-e9b3-4b61-85c7-8df5281c7a78 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:14.646741 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:14.693566 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7c86e-e67a-4d3a-8a67-8599dd849a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:14.694233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c86e-e67a-4d3a-8a67-8599dd849a21 admin admin] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:14.694536 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c86e-e67a-4d3a-8a67-8599dd849a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:14.694813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c86e-e67a-4d3a-8a67-8599dd849a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:14.695659 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7c86e-e67a-4d3a-8a67-8599dd849a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:14.697280 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7c86e-e67a-4d3a-8a67-8599dd849a21 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:14.711521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1433/2890] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 16 00:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:50:14.711979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd43a6d-0659-4b78-85ed-1ddb3054ff14 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:14.723185 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd43a6d-0659-4b78-85ed-1ddb3054ff14 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:14.727928 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde85b9f-29cd-4c5f-b517-9d4c9926a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:14.728804 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde85b9f-29cd-4c5f-b517-9d4c9926a53b admin admin] REQUEST_METHOD: `PUT` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:14.729087 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde85b9f-29cd-4c5f-b517-9d4c9926a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:14.729371 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde85b9f-29cd-4c5f-b517-9d4c9926a53b admin admin] PATH_INFO: `/v3/projects/5581b4bf5c2844559d61b1ef4c445b33/users/dfef5f0bed7143f08f300112ead254ee/roles/635caa85d8524fb887206fd521defd3f` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:14.731328 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde85b9f-29cd-4c5f-b517-9d4c9926a53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5581b4bf5c2844559d61b1ef4c445b33, user_id=dfef5f0bed7143f08f300112ead254ee, role_id=635caa85d8524fb887206fd521defd3f)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:14.734687 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde85b9f-29cd-4c5f-b517-9d4c9926a53b admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:14.745788 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1458/2891] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 16 00:50:14 2022] PUT /identity/v3/projects/5581b4bf5c2844559d61b1ef4c445b33/users/dfef5f0bed7143f08f300112ead254ee/roles/635caa85d8524fb887206fd521defd3f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:50:20.406949 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bdc6a-756e-4833-acc0-c929f3e21869 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:20.407520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bdc6a-756e-4833-acc0-c929f3e21869 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:20.407520 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bdc6a-756e-4833-acc0-c929f3e21869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:20.436480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-3d4bdc6a-756e-4833-acc0-c929f3e21869 None None] MFA Rules not processed for user `dfef5f0bed7143f08f300112ead254ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:50:20.437755 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3d4bdc6a-756e-4833-acc0-c929f3e21869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:20.509961 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1434/2892] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:50:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:50:20.522583 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde85b9f-29cd-4c5f-b517-9d4c9926a53b admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:20.524457 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-cde85b9f-29cd-4c5f-b517-9d4c9926a53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:20.584538 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde85b9f-29cd-4c5f-b517-9d4c9926a53b admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:20.588486 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b069a-3a82-4a69-b9ab-ae5395ce49bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24198f20ebcd4e64a5184fb9fc6764cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:20.589162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b069a-3a82-4a69-b9ab-ae5395ce49bf service glance] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:20.589449 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b069a-3a82-4a69-b9ab-ae5395ce49bf service glance] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:20.589747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b069a-3a82-4a69-b9ab-ae5395ce49bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:20.617856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:20.652092 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b069a-3a82-4a69-b9ab-ae5395ce49bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:20.653550 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b069a-3a82-4a69-b9ab-ae5395ce49bf service glance] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:20.663563 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1459/2893] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:50:20.932718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe9882-7b50-42de-9843-bb733a1e6154 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:20.933017 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe9882-7b50-42de-9843-bb733a1e6154 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:20.933293 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe9882-7b50-42de-9843-bb733a1e6154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:20.951963 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-0abe9882-7b50-42de-9843-bb733a1e6154 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:50:20.953196 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-0abe9882-7b50-42de-9843-bb733a1e6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:21.007541 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1435/2894] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:50:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:50:21.142348 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b069a-3a82-4a69-b9ab-ae5395ce49bf service glance] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:21.143925 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-1b5b069a-3a82-4a69-b9ab-ae5395ce49bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:21.214968 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b069a-3a82-4a69-b9ab-ae5395ce49bf service glance] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:21.219979 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7c4a-5ff0-47d0-a2b1-6f12d49433f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:21.220638 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7c4a-5ff0-47d0-a2b1-6f12d49433f1 service swift] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:21.220924 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7c4a-5ff0-47d0-a2b1-6f12d49433f1 service swift] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:21.221204 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7c4a-5ff0-47d0-a2b1-6f12d49433f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:21.229760 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a7c4a-5ff0-47d0-a2b1-6f12d49433f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:21.231627 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a7c4a-5ff0-47d0-a2b1-6f12d49433f1 service swift] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:21.240109 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1460/2895] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:50:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:50:31.000641 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=80 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:31.170502 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffd11e-93fb-4f9d-9205-fa8ae12f35f5 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:31.171454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffd11e-93fb-4f9d-9205-fa8ae12f35f5 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:31.171454 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffd11e-93fb-4f9d-9205-fa8ae12f35f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:31.188937 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-b5ffd11e-93fb-4f9d-9205-fa8ae12f35f5 None None] MFA Rules not processed for user `85172422aa1844edb85eee1a6072291f`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:50:31.190141 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-b5ffd11e-93fb-4f9d-9205-fa8ae12f35f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:31.197007 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1436/2896] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 16 00:50:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:50:31.236751 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=48 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:31.815517 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7c4a-5ff0-47d0-a2b1-6f12d49433f1 service swift] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:31.817045 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-859a7c4a-5ff0-47d0-a2b1-6f12d49433f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:31.888279 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7c4a-5ff0-47d0-a2b1-6f12d49433f1 service swift] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:31.893611 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdc224-954f-4535-8826-f3d4ce95e074 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:31.894255 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdc224-954f-4535-8826-f3d4ce95e074 service placement] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:31.894566 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdc224-954f-4535-8826-f3d4ce95e074 service placement] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:31.894849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdc224-954f-4535-8826-f3d4ce95e074 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:31.896620 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-f6cdc224-954f-4535-8826-f3d4ce95e074 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:31.908674 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdc224-954f-4535-8826-f3d4ce95e074 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:31.910362 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdc224-954f-4535-8826-f3d4ce95e074 service placement] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:31.921144 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1461/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:50:34.599552 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df234b61-606a-4609-941b-5fe6fad597b4 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:34.600052 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df234b61-606a-4609-941b-5fe6fad597b4 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:34.604094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df234b61-606a-4609-941b-5fe6fad597b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:34.617958 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-df234b61-606a-4609-941b-5fe6fad597b4 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:50:34.619252 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-df234b61-606a-4609-941b-5fe6fad597b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:34.627298 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1437/2898] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 16 00:50:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:50:34.640390 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdc224-954f-4535-8826-f3d4ce95e074 service placement] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:34.651781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdc224-954f-4535-8826-f3d4ce95e074 service placement] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:34.656691 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cb720-8435-41e4-8d1c-d8dd37353bd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:34.657373 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cb720-8435-41e4-8d1c-d8dd37353bd8 service swift] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:34.657686 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cb720-8435-41e4-8d1c-d8dd37353bd8 service swift] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:34.657960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cb720-8435-41e4-8d1c-d8dd37353bd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:34.666248 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cb720-8435-41e4-8d1c-d8dd37353bd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:34.667886 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cb720-8435-41e4-8d1c-d8dd37353bd8 service swift] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:34.676764 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1462/2899] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:50:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:50:43.096610 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df234b61-606a-4609-941b-5fe6fad597b4 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:43.149153 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df234b61-606a-4609-941b-5fe6fad597b4 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:43.153216 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44530c3a-108c-450e-9227-7917a24bc30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:43.153859 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530c3a-108c-450e-9227-7917a24bc30b service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:43.154146 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530c3a-108c-450e-9227-7917a24bc30b service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:43.154426 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530c3a-108c-450e-9227-7917a24bc30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:43.156225 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-44530c3a-108c-450e-9227-7917a24bc30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:43.165558 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44530c3a-108c-450e-9227-7917a24bc30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:43.166982 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44530c3a-108c-450e-9227-7917a24bc30b service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:43.175564 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1438/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:50:44.673366 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=38 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:49.526878 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cb720-8435-41e4-8d1c-d8dd37353bd8 service swift] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:49.529193 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-922cb720-8435-41e4-8d1c-d8dd37353bd8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:49.601034 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cb720-8435-41e4-8d1c-d8dd37353bd8 service swift] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:49.606936 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f37de-ae6d-48bc-a607-9e56523c2b67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:49.607787 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f37de-ae6d-48bc-a607-9e56523c2b67 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:49.607938 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f37de-ae6d-48bc-a607-9e56523c2b67 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:49.608162 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f37de-ae6d-48bc-a607-9e56523c2b67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:49.610149 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-927f37de-ae6d-48bc-a607-9e56523c2b67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:49.622960 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f37de-ae6d-48bc-a607-9e56523c2b67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:49.624857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f37de-ae6d-48bc-a607-9e56523c2b67 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:49.635974 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1463/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:50:53.172011 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=32 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:57.262944 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44530c3a-108c-450e-9227-7917a24bc30b service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:57.271975 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44530c3a-108c-450e-9227-7917a24bc30b service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:57.275518 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a6d2e-7d8c-42f5-b413-29a6656ae26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b4902b340a4260a0b5f716c3ae9acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:57.276181 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a6d2e-7d8c-42f5-b413-29a6656ae26e service neutron] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:57.276466 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a6d2e-7d8c-42f5-b413-29a6656ae26e service neutron] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:57.276745 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a6d2e-7d8c-42f5-b413-29a6656ae26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:57.285496 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a6d2e-7d8c-42f5-b413-29a6656ae26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:57.286911 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a6d2e-7d8c-42f5-b413-29a6656ae26e service neutron] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:57.296094 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1439/2902] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:50:59.631017 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=34 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:51:07.292059 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=6 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:51:33.155172 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f37de-ae6d-48bc-a607-9e56523c2b67 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:51:33.168888 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f37de-ae6d-48bc-a607-9e56523c2b67 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:51:33.176073 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a20f5e-39d4-433a-887c-c5a834107fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba29f9c029fe4390af3b6ce1b2147ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:51:33.176857 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20f5e-39d4-433a-887c-c5a834107fc6 service nova] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:51:33.177093 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20f5e-39d4-433a-887c-c5a834107fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:51:33.177374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20f5e-39d4-433a-887c-c5a834107fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:51:33.179641 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-39a20f5e-39d4-433a-887c-c5a834107fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:51:33.193431 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a20f5e-39d4-433a-887c-c5a834107fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:51:33.195221 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a20f5e-39d4-433a-887c-c5a834107fc6 service nova] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:51:33.208504 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1464/2903] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:51:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:51:40.900431 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a6d2e-7d8c-42f5-b413-29a6656ae26e service neutron] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:51:40.912543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a6d2e-7d8c-42f5-b413-29a6656ae26e service neutron] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:51:40.917838 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:51:40.918480 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:51:40.918763 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:51:40.919040 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:51:40.920881 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:51:40.933330 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:51:40.934899 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:51:40.945002 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1440/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:51:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:51:43.209187 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=6 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:51:44.703645 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a20f5e-39d4-433a-887c-c5a834107fc6 service nova] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:51:44.716052 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a20f5e-39d4-433a-887c-c5a834107fc6 service nova] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:51:44.721263 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f787-731a-4b21-ad49-3cfdf971d30b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:51:44.723480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f787-731a-4b21-ad49-3cfdf971d30b service placement] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:51:44.723480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f787-731a-4b21-ad49-3cfdf971d30b service placement] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:51:44.723480 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946f787-731a-4b21-ad49-3cfdf971d30b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:51:44.724350 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-c946f787-731a-4b21-ad49-3cfdf971d30b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:51:44.736616 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946f787-731a-4b21-ad49-3cfdf971d30b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:51:44.738190 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946f787-731a-4b21-ad49-3cfdf971d30b service placement] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:51:44.749225 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1465/2905] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:51:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:51:44.842805 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:51:44.844464 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:51:44.909922 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e2c3d-579d-4e80-94ec-ea86e44f0ea4 service placement] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:51:44.914448 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:51:44.915260 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:51:44.915546 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:51:44.915916 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] PATH_INFO: `/v3/users/f07248b03aa14db19f896333e2064f2d` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:51:44.917130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07248b03aa14db19f896333e2064f2d)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:51:44.919022 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:51:45.052979 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07248b03aa14db19f896333e2064f2d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.053634 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07248b03aa14db19f896333e2064f2d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.108124 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07248b03aa14db19f896333e2064f2d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.115276 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07248b03aa14db19f896333e2064f2d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.127080 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07248b03aa14db19f896333e2064f2d'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.132976 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1441/2906] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:51:44 2022] DELETE /identity/v3/users/f07248b03aa14db19f896333e2064f2d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:51:45.360747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f787-731a-4b21-ad49-3cfdf971d30b service placement] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:51:45.371781 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946f787-731a-4b21-ad49-3cfdf971d30b service placement] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:51:45.428312 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:51:45.429181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:51:45.429466 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:51:45.429742 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] PATH_INFO: `/v3/projects/0e24e679d8204d248892ce4328557c8c` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:51:45.430913 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e24e679d8204d248892ce4328557c8c)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:51:45.433374 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:51:45.541041 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e24e679d8204d248892ce4328557c8c', 'request_id': 'req-b21c3647-cc87-4d3c-9fe9-482b18dc7215'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.547063 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e24e679d8204d248892ce4328557c8c', 'request_id': 'req-b21c3647-cc87-4d3c-9fe9-482b18dc7215'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.553154 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e24e679d8204d248892ce4328557c8c', 'request_id': 'req-b21c3647-cc87-4d3c-9fe9-482b18dc7215'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.625911 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] The token cache is being invalidate because project 0e24e679d8204d248892ce4328557c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:51:45.626131 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.626747 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.628364 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1466/2907] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:51:45 2022] DELETE /identity/v3/projects/0e24e679d8204d248892ce4328557c8c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:51:45.632393 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:51:45.633783 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:51:45.647441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcfd96-d576-4305-a5bf-53b492a32462 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:51:45.703778 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:51:45.704640 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:51:45.704914 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:51:45.705183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] PATH_INFO: `/v3/users/d6f1985fcf444662a256ca0ee3c79eec` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:51:45.706352 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f1985fcf444662a256ca0ee3c79eec)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:51:45.708299 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:51:45.714159 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:51:45.894270 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f1985fcf444662a256ca0ee3c79eec'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.894893 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f1985fcf444662a256ca0ee3c79eec'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.946751 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f1985fcf444662a256ca0ee3c79eec'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.955960 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f1985fcf444662a256ca0ee3c79eec'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.968157 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-013da9a5-1ed0-4e48-bcbd-db1f793b1067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f1985fcf444662a256ca0ee3c79eec'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:45.974391 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1442/2908] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:51:45 2022] DELETE /identity/v3/users/d6f1985fcf444662a256ca0ee3c79eec => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:51:46.206883 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:51:46.208343 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:51:46.223591 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c3647-cc87-4d3c-9fe9-482b18dc7215 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:51:46.281101 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:51:46.281958 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:51:46.282235 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:51:46.282507 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] PATH_INFO: `/v3/projects/c09a2fcdeb644fde8de8555f4aedd2c3` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:51:46.283690 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09a2fcdeb644fde8de8555f4aedd2c3)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:51:46.285607 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:51:46.306006 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:51:46.401181 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09a2fcdeb644fde8de8555f4aedd2c3', 'request_id': 'req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:46.406856 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09a2fcdeb644fde8de8555f4aedd2c3', 'request_id': 'req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:46.413315 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09a2fcdeb644fde8de8555f4aedd2c3', 'request_id': 'req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:46.501525 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] The token cache is being invalidate because project c09a2fcdeb644fde8de8555f4aedd2c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:51:46.501728 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:46.502355 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:51:46.504304 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1467/2909] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:51:46 2022] DELETE /identity/v3/projects/c09a2fcdeb644fde8de8555f4aedd2c3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:51:55.970718 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:51:56.498103 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:52:25.391824 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb0802-a8fc-42f8-91a0-cf25a6eee8d8 None None] REQUEST_METHOD: `POST` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:52:25.392334 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb0802-a8fc-42f8-91a0-cf25a6eee8d8 None None] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:52:25.392420 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb0802-a8fc-42f8-91a0-cf25a6eee8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:52:25.432303 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.auth.core [None req-15eb0802-a8fc-42f8-91a0-cf25a6eee8d8 None None] MFA Rules not processed for user `32f11d0d46f94beba8913591371d5e33`. Rule list: `[]` (Enabled: `True`). {{(pid=97111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:52:25.433521 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-15eb0802-a8fc-42f8-91a0-cf25a6eee8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:52:25.504046 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1443/2910] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 16 00:52:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:52:25.544049 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:52:25.545442 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:52:25.635952 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e07be-4b1f-46dc-9064-ff0e7055d7c0 admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:52:25.641198 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e00b7-48e0-4f1c-ad6a-95a778d42374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ccca2836bc4004bcf39a3070b6c54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:52:25.641836 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e00b7-48e0-4f1c-ad6a-95a778d42374 service swift] REQUEST_METHOD: `GET` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:52:25.642122 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e00b7-48e0-4f1c-ad6a-95a778d42374 service swift] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:52:25.642403 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e00b7-48e0-4f1c-ad6a-95a778d42374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:52:25.651067 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e00b7-48e0-4f1c-ad6a-95a778d42374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:52:25.652685 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e00b7-48e0-4f1c-ad6a-95a778d42374 service swift] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:52:25.660711 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1468/2911] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 16 00:52:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:52:33.417192 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb0802-a8fc-42f8-91a0-cf25a6eee8d8 None None] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:52:33.418713 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-15eb0802-a8fc-42f8-91a0-cf25a6eee8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:52:33.514724 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb0802-a8fc-42f8-91a0-cf25a6eee8d8 None None] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:52:33.519268 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:52:33.520158 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:52:33.520441 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:52:33.520715 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] PATH_INFO: `/v3/users/85172422aa1844edb85eee1a6072291f` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:52:33.521951 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85172422aa1844edb85eee1a6072291f)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:52:33.524369 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:52:33.669543 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:52:33.674753 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85172422aa1844edb85eee1a6072291f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:33.676251 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85172422aa1844edb85eee1a6072291f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:33.747082 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85172422aa1844edb85eee1a6072291f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:33.754240 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85172422aa1844edb85eee1a6072291f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:33.766452 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85172422aa1844edb85eee1a6072291f'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:33.772350 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1444/2912] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:52:33 2022] DELETE /identity/v3/users/85172422aa1844edb85eee1a6072291f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:52:34.000736 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e00b7-48e0-4f1c-ad6a-95a778d42374 service swift] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:52:34.013138 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e00b7-48e0-4f1c-ad6a-95a778d42374 service swift] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:52:34.074289 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:52:34.075151 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:52:34.075434 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:52:34.075716 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] PATH_INFO: `/v3/projects/e5e40c7d9b3145c4af0a03e0581e5fb3` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:52:34.077018 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e40c7d9b3145c4af0a03e0581e5fb3)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:52:34.078840 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:52:34.187381 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e40c7d9b3145c4af0a03e0581e5fb3', 'request_id': 'req-7854da04-70fb-4186-a05b-24d59af2312e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.193071 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e40c7d9b3145c4af0a03e0581e5fb3', 'request_id': 'req-7854da04-70fb-4186-a05b-24d59af2312e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.200084 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e40c7d9b3145c4af0a03e0581e5fb3', 'request_id': 'req-7854da04-70fb-4186-a05b-24d59af2312e'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.203700 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:52:34.243561 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] The token cache is being invalidate because project e5e40c7d9b3145c4af0a03e0581e5fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:52:34.243880 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.244500 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.246059 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1469/2913] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:52:33 2022] DELETE /identity/v3/projects/e5e40c7d9b3145c4af0a03e0581e5fb3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:52:34.250006 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:52:34.251450 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:52:34.265233 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452bc39-bfff-4040-b518-303f60ee454e admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:52:34.320940 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:52:34.321919 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:52:34.322201 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:52:34.322477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] PATH_INFO: `/v3/users/dfef5f0bed7143f08f300112ead254ee` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:52:34.323653 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfef5f0bed7143f08f300112ead254ee)` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:52:34.325584 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:52:34.530813 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfef5f0bed7143f08f300112ead254ee'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.531477 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfef5f0bed7143f08f300112ead254ee'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.598130 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfef5f0bed7143f08f300112ead254ee'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.605948 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfef5f0bed7143f08f300112ead254ee'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.618205 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.notifications [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfef5f0bed7143f08f300112ead254ee'} {{(pid=97111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:34.624231 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1445/2914] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 16 00:52:34 2022] DELETE /identity/v3/users/dfef5f0bed7143f08f300112ead254ee => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:52:34.862800 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] Authenticating user token {{(pid=97110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:52:34.865849 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.fernet_utils [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:52:34.877704 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854da04-70fb-4186-a05b-24d59af2312e admin admin] Validating token access rules against request {{(pid=97110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:52:34.936069 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b772abf551ba4a3bbcb1567e3ad5b88c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3ad4439044a4113a3a2bd5f12c4d6da', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:52:34.936926 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:52:34.937213 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] SCRIPT_NAME: `/identity` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:52:34.937487 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] PATH_INFO: `/v3/projects/5581b4bf5c2844559d61b1ef4c445b33` {{(pid=97110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:52:34.938663 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5581b4bf5c2844559d61b1ef4c445b33)` {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:52:34.940614 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] RBAC: Authorization granted {{(pid=97110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:52:35.021197 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5581b4bf5c2844559d61b1ef4c445b33', 'request_id': 'req-a50c98eb-24f5-42f2-9b17-0d9b6387978d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:35.027296 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5581b4bf5c2844559d61b1ef4c445b33', 'request_id': 'req-a50c98eb-24f5-42f2-9b17-0d9b6387978d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:35.033692 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5581b4bf5c2844559d61b1ef4c445b33', 'request_id': 'req-a50c98eb-24f5-42f2-9b17-0d9b6387978d'} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:35.094727 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] The token cache is being invalidate because project 5581b4bf5c2844559d61b1ef4c445b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:52:35.095039 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:35.095640 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG keystone.notifications [None req-a50c98eb-24f5-42f2-9b17-0d9b6387978d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:52:35.097192 dv-cinder-803823-11-smb devstack@keystone.service[97110]: [pid: 97110|app: 0|req: 1470/2915] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 16 00:52:34 2022] DELETE /identity/v3/projects/5581b4bf5c2844559d61b1ef4c445b33 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:52:44.620643 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:52:45.091543 dv-cinder-803823-11-smb devstack@keystone.service[97110]: DEBUG dbcounter [-] [97110] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:53:09.028575 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] Authenticating user token {{(pid=97111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:53:09.030025 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:53:09.119203 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807555a-7176-4a79-b912-3f7f25736c22 admin admin] Validating token access rules against request {{(pid=97111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:53:09.176164 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa390e7-60bd-497b-99ff-4e35a220e7df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e57a7647d143f5835225616138827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c32b0c270c2427799bc5b3255db1f6c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:53:09.176808 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa390e7-60bd-497b-99ff-4e35a220e7df service placement] REQUEST_METHOD: `GET` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:53:09.177093 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa390e7-60bd-497b-99ff-4e35a220e7df service placement] SCRIPT_NAME: `/identity` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:53:09.177375 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa390e7-60bd-497b-99ff-4e35a220e7df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:53:09.179160 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.fernet_utils [None req-1fa390e7-60bd-497b-99ff-4e35a220e7df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:53:09.190183 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa390e7-60bd-497b-99ff-4e35a220e7df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:53:09.191789 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa390e7-60bd-497b-99ff-4e35a220e7df service placement] RBAC: Authorization granted {{(pid=97111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:53:09.201526 dv-cinder-803823-11-smb devstack@keystone.service[97111]: [pid: 97111|app: 0|req: 1446/2916] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 16 00:53:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:53:19.197323 dv-cinder-803823-11-smb devstack@keystone.service[97111]: DEBUG dbcounter [-] [97111] Writing DB stats keystone:SELECT=67 {{(pid=97111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}